00000001:02000400:0.0F:1789708531.209248:0:2964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1789708542.179527:0:3163:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1789708543.411382:0:3223:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1055 MB/s 00000001:01000000:2.0F:1789708543.661484:0:3223:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1279 MB/s 00000001:01000000:2.0:1789708543.910811:0:3223:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5035 MB/s 00000020:02000000:2.0:1789708544.348382:0:3255:0:(class_obd.c:777:obdclass_init()) Lustre: Build Version: 2.17.58_39_g8752880 00000400:02000000:1.0F:1789708545.005512:0:3270:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.153@tcp [8/256/0/180] 00008000:02000000:0.0:1789708547.968233:0:3419:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789708576.481954:0:5223:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789708581.981455:0:5800:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789708581.981461:0:5800:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789708581.981602:0:5800:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000051d14b51 00000080:02000400:1.0:1789708581.981614:0:5800:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789708581.986453:0:5800:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789708581.986466:0:5800:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789708581.986502:0:5800:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000006a2f9df0) 00000020:00000080:1.0:1789708581.986518:0:5800:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789708582.001074:0:5800:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789708582.001506:0:5800:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789708582.017947:0:5800:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789708582.017988:0:5800:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789708582.018013:0:5800:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789708582.018071:0:5800:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789708582.018112:0:5800:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789708582.018484:0:5800:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789708582.018493:0:5800:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789708582.018504:0:5800:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa8f741d1c6865dc4 00000020:01000004:3.0:1789708582.018511:0:5800:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789708582.018516:0:5800:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789708582.018521:0:5800:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000051d14b51 from MGS 00000020:01000004:3.0:1789708582.018526:0:5800:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789708582.018543:0:5800:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000093a95ea3) 00000020:00000080:3.0:1789708582.018555:0:5800:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789708582.018847:0:5800:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000051d14b51 from MGS, refs=2 00080000:01000000:3.0:1789708582.018853:0:5800:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789708582.018861:0:5800:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa8f741d1c6865dd2 00000100:00100000:3.0:1789708582.018962:0:5800:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789708582.019094:0:5800:0:(service.c:3474:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789708582.019100:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789708582.019823:0:5800:0:(service.c:3474:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789708582.019829:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789708582.020945:0:5800:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708582.021099:0:5800:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789708582.021104:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789708582.021758:0:5800:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789708582.021765:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789708582.022059:0:5800:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789708582.022065:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789708582.022903:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708582.022907:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708582.022908:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708582.023268:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708582.023270:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708582.023272:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708582.023825:0:5800:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789708582.026773:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789708582.277280:0:5800:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4169 MB/s 00000001:01000000:1.0:1789708582.526759:0:5800:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3187 MB/s 00000001:01000000:2.0:1789708582.777208:0:5800:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 811 MB/s 00000001:01000000:2.0:1789708583.027275:0:5800:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1483 MB/s 00080000:10000000:2.0:1789708583.032644:0:5800:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1789708583.034963:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789708583.048642:0:5800:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789708583.048684:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789708583.048687:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789708583.055039:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789708583.055135:0:5800:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789708583.055192:0:5800:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789708583.055451:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789708583.055485:0:5800:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789708583.056151:0:5800:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708583.056321:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789708583.056327:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789708583.057012:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789708583.057020:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789708583.057303:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789708583.057309:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789708583.058166:0:5800:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789708583.058187:0:5800:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.153@tcp' 00000020:01000004:1.0:1789708583.058189:0:5800:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789708583.058240:0:5800:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.153@tcp (typ=mgc) 00000020:00000080:1.0:1789708583.058251:0:5800:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.153@tcp (00000000c8ef004c) 00000020:00000080:1.0:1789708583.058267:0:5800:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789708583.058364:0:5800:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d33a64bf@MGC192.168.202.153@tcp: add connection 192.168.202.153@tcp at head 00010000:00010000:1.0:1789708583.058509:0:5800:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.153@tcp-0 is initialized 00000040:01000000:1.0:1789708583.058515:0:5800:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789708583.062353:0:5816:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789708583.062416:0:5800:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.153@tcp (uuid 34efb293-a6d4-48d2-a113-9ec9a49feb73) 00000020:00000080:3.0:1789708583.062441:0:5800:0:(genops.c:1384:class_connect()) connect: client 34efb293-a6d4-48d2-a113-9ec9a49feb73, cookie 0xa8f741d1c6865de0 00000100:00080000:3.0:1789708583.062453:0:5800:0:(import.c:545:import_select_connection()) MGC192.168.202.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789708583.062462:0:5800:0:(import.c:666:import_select_connection()) MGC192.168.202.153@tcp: import 00000000d33a64bf using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1789708583.062509:0:5800:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e8125aaa x1876645426233472/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708583.062531:0:5800:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 34efb293-a6d4-48d2-a113-9ec9a49feb73->MGS 00000020:01000004:3.0:1789708583.062558:0:5800:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789708583.062582:0:5800:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789708583.062595:0:5800:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000604bdae8) 00000020:00000080:3.0:1789708583.062608:0:5800:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789708583.065328:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8125aaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:34efb293-a6d4-48d2-a113-9ec9a49feb73:3285:1876645426233472:0@lo:250: 00000100:00100000:1.0:1789708583.065433:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708583.065754:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426233472 00000100:00100000:1.0:1789708583.065770:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426233472 00000100:00100000:1.0:1789708583.065800:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789708583.065806:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000019705e04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3285:x1876645426233472:12345-0@lo:250: 00010000:00080000:1.0:1789708583.065829:0:5812:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 34efb293-a6d4-48d2-a113-9ec9a49feb73@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:1.0:1789708583.065852:0:5812:0:(genops.c:1384:class_connect()) connect: client 34efb293-a6d4-48d2-a113-9ec9a49feb73, cookie 0xa8f741d1c6865dee 00000100:00080000:1.0:1789708583.065973:0:5812:0:(import.c:65:import_set_state_nolock()) 000000002cb0c1bb : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708583.066020:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000019705e04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+5:3285:x1876645426233472:12345-0@lo:250: Request processed in 213us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708583.066027:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789708583.066057:0:3285:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789708583.066065:0:3285:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.153@tcp: connect to target with instance 0 00000100:00080000:1.0:1789708583.066071:0:3285:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789708583.066074:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789708583.066077:0:3285:0:(import.c:65:import_set_state_nolock()) 00000000d33a64bf MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789708583.066079:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789708583.066086:0:3285:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789708583.066090:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8125aaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:34efb293-a6d4-48d2-a113-9ec9a49feb73:3285:1876645426233472:0@lo:250: 00000100:00080000:1.0:1789708583.066423:0:5815:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1789708583.092549:0:5800:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708583.092944:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789708583.092950:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789708583.093573:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789708583.093580:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789708583.094094:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789708583.094101:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789708583.095425:0:5800:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708583.095646:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789708583.095906:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789708583.096363:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789708583.096371:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789708583.161921:0:5800:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789708583.162151:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789708583.162159:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789708583.164858:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789708583.164874:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789708583.165585:0:5800:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789708583.165933:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789708583.165939:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789708583.166379:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789708583.166385:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789708583.167941:0:5800:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789708583.168132:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789708583.168138:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789708583.172634:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789708583.172645:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789708583.173303:0:5800:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789708583.173470:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789708583.173476:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789708583.173926:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789708583.173933:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789708583.208250:0:5800:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789708583.208454:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789708583.208461:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789708583.210202:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789708583.210212:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789708583.211564:0:5800:0:(service.c:3474:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789708583.211574:0:5800:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789708583.212930:0:5800:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789708583.212955:0:5800:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789708583.212966:0:5800:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789708583.213119:0:5800:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789708583.213155:0:5800:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.153@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789708583.213160:0:5800:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789708583.213161:0:5800:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789708583.213163:0:5800:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708583.213164:0:5800:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708583.213165:0:5800:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708583.213166:0:5800:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708583.213168:0:5800:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789708583.213169:0:5800:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789708583.213171:0:5800:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789708583.213172:0:5800:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789708583.213173:0:5800:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708583.213174:0:5800:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789708583.213177:0:5800:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789708583.213179:0:5800:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789708583.213180:0:5800:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789708583.213181:0:5800:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708583.213182:0:5800:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708583.213183:0:5800:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708583.213184:0:5800:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708583.213185:0:5800:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789708583.213185:0:5800:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789708583.213186:0:5800:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789708583.213187:0:5800:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789708583.213188:0:5800:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708583.213189:0:5800:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789708583.213230:0:5800:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789708583.213247:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426233600:0@lo:253: 00000100:00100000:0.0:1789708583.213332:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708583.213412:0:5800:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003ea3971 going to sleep for 11 seconds 00000100:00100000:1.0:1789708583.213591:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426233600 00000100:00100000:1.0:1789708583.213598:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426233600 00000100:00100000:1.0:1789708583.213747:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708583.213759:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000080d0ee31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+5:5800:x1876645426233600:12345-0@lo:253: 20000000:01000000:1.0:1789708583.213815:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789708583.213818:0:5814:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1789708583.214161:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789708583.214210:0:5814:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789708583.214552:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789708583.215336:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789708583.215540:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789708583.215543:0:5814:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789708583.215549:0:5814:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789708583.215552:0:5814:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789708583.215567:0:5814:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789708583.215841:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708583.216021:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789708583.216032:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789708583.216078:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789708583.216141:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789708583.216177:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789708583.216279:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789708583.216288:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789708583.216333:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789708583.216341:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789708583.216373:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789708583.216380:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789708583.216411:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789708583.216459:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789708583.216501:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789708583.216511:0:5814:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789708583.216535:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708583.216974:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789708583.216983:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789708583.217025:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789708583.217057:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789708583.217114:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789708583.217132:0:5814:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789708583.217211:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789708583.217219:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789708583.217261:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789708583.217306:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789708583.217337:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789708583.217351:0:5814:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789708583.217447:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789708583.217455:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789708583.217481:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789708583.217511:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789708583.217980:0:5814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789708583.218064:0:5814:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789708583.218073:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1789708583.218460:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789708583.218900:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789708583.218920:0:5814:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.153@tcp for mdt 20000000:01000000:1.0:1789708583.218921:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:1.0:1789708583.218952:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789708583.218959:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789708583.218985:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789708583.218991:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:1.0:1789708583.219029:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789708583.219038:0:5814:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789708583.219066:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789708583.219127:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789708583.219204:0:5814:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789708583.219208:0:5814:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789708583.219211:0:5814:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789708583.219223:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789708583.219225:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789708583.219253:0:5814:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789708583.219255:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789708583.219595:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789708583.219920:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789708583.219960:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789708583.219994:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1789708583.220012:0:5814:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789708583.220013:0:5814:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789708583.220419:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1789708583.220617:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1789708583.220646:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1789708583.220844:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1789708583.220860:0:5814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789708583.220863:0:5814:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1789708583.220867:0:5814:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789708583.220869:0:5814:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789708583.220872:0:5814:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789708583.220877:0:5814:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789708583.221180:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1789708583.221300:0:5814:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789708583.227274:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1789708583.227329:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1789708583.227404:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1789708583.227431:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789708583.227475:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000df31e817/0xa8f741d1c6865df5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.227491:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df31e817/0xa8f741d1c6865df5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.227500:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000df31e817/0xa8f741d1c6865df5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.227506:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000df31e817/0xa8f741d1c6865df5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.227512:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000df31e817/0xa8f741d1c6865df5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.227519:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000df31e817/0xa8f741d1c6865df5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.227525:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000df31e817 already unused, calling callback (0000000035918db3) 00010000:00010000:1.0:1789708583.227535:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000df31e817/0xa8f741d1c6865df5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.227542:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000df31e817/0xa8f741d1c6865df5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.227554:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000df31e817/0xa8f741d1c6865df5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.227561:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000df31e817/0xa8f741d1c6865df5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.227578:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000df31e817/0xa8f741d1c6865df5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789708583.227597:0:5814:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789708583.381476:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000080d0ee31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+5:5800:x1876645426233600:12345-0@lo:253: Request processed in 167713us (168138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708583.381496:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708583.381525:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426233600:0@lo:253: 10000000:01000000:0.0:1789708583.381557:0:5800:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789708583.381561:0:5800:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789708583.381563:0:5800:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789708583.381564:0:5800:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708583.381574:0:5800:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789708583.381575:0:5800:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708583.381576:0:5800:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708583.381577:0:5800:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789708583.381579:0:5800:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789708583.381580:0:5800:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789708583.381582:0:5800:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708583.381583:0:5800:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789708583.381611:0:5800:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000051d14b51 from lustre-MDT0000 10000000:01000000:0.0:1789708583.381638:0:5800:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789708583.381640:0:5800:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789708583.381644:0:5800:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a1407ea19c0 10000000:01000000:0.0:1789708583.381666:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789708583.381675:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a1407ea19c0 from 1 10000000:01000000:0.0:1789708583.381678:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789708583.381710:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000514c2c79/0xa8f741d1c6865dfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.381720:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000514c2c79/0xa8f741d1c6865dfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.381728:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000514c2c79/0xa8f741d1c6865dfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708583.381745:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426233728:0@lo:101: 00000100:00100000:0.0:1789708583.381781:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708583.381840:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426233728 00000100:00100000:0.0:1789708583.381847:0:5800:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a124e29d going to sleep for 11 seconds 00000100:00100000:1.0:1789708583.381848:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426233728 00000100:00100000:1.0:1789708583.381888:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708583.381895:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000213d94d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+5:5800:x1876645426233728:12345-0@lo:101: 00010000:00010000:1.0:1789708583.381908:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708583.381921:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df31e817/0xa8f741d1c6865e03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865dfc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.381943:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df31e817/0xa8f741d1c6865e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865dfc expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.381952:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df31e817/0xa8f741d1c6865e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865dfc expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.381963:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df31e817, rc 0) 00000100:00100000:1.0:1789708583.382013:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000213d94d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+6:5800:x1876645426233728:12345-0@lo:101: Request processed in 118us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708583.382019:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708583.382084:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426233728:0@lo:101: 00010000:00010000:0.0:1789708583.382112:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000514c2c79/0xa8f741d1c6865dfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e03 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.382119:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000514c2c79/0xa8f741d1c6865dfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865e03 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708583.382160:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426233856:0@lo:501: 00000100:00100000:0.0:1789708583.382184:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708583.382199:0:5800:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a124e29d going to sleep for 11 seconds 00000100:00100000:3.0:1789708583.382388:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426233856 00000100:00100000:3.0:1789708583.382393:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426233856 00000100:00100000:3.0:1789708583.382430:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789708583.382436:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000ff6d159 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+6:5800:x1876645426233856:12345-0@lo:501: 00000100:00100000:3.0:1789708583.382647:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000ff6d159 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+6:5800:x1876645426233856:12345-0@lo:501: Request processed in 211us (462us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789708583.382686:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789708583.382762:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426233856:0@lo:501: 10000000:01000000:0.0:1789708583.382787:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789708583.382802:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000514c2c79/0xa8f741d1c6865dfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e03 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.382810:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000514c2c79/0xa8f741d1c6865dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e03 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708583.382817:0:5800:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a1410604800 10000000:01000000:0.0:1789708583.382821:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789708583.382824:0:5800:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a1410604800 10000000:01000000:0.0:1789708583.382826:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789708583.382829:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a1410604800 from 1 10000000:01000000:0.0:1789708583.382830:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789708583.382846:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 0000000068dbec3c/0xa8f741d1c6865e0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.382852:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 0000000068dbec3c/0xa8f741d1c6865e0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.382869:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 0000000068dbec3c/0xa8f741d1c6865e0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708583.382881:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426233984:0@lo:101: 00000100:00100000:0.0:1789708583.382907:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708583.382934:0:5800:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a124e29d going to sleep for 11 seconds 00000100:00100000:1.0:1789708583.382957:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426233984 00000100:00100000:1.0:1789708583.382962:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426233984 00000100:00100000:1.0:1789708583.382992:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789708583.382998:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b8558d2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+6:5800:x1876645426233984:12345-0@lo:101: 00010000:00010000:1.0:1789708583.383005:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708583.383014:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bcbc44a7/0xa8f741d1c6865e11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865e0a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.383027:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bcbc44a7/0xa8f741d1c6865e11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865e0a expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.383035:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bcbc44a7/0xa8f741d1c6865e11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865e0a expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.383043:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bcbc44a7, rc 0) 00000100:00100000:1.0:1789708583.383139:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b8558d2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+7:5800:x1876645426233984:12345-0@lo:101: Request processed in 142us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708583.383146:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708583.383519:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426233984:0@lo:101: 00010000:00010000:0.0:1789708583.383530:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 0000000068dbec3c/0xa8f741d1c6865e0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e11 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.383538:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 0000000068dbec3c/0xa8f741d1c6865e0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865e11 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708583.383549:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789708583.383599:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 0000000068dbec3c/0xa8f741d1c6865e0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e11 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.383606:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 0000000068dbec3c/0xa8f741d1c6865e0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e11 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708583.383612:0:5800:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789708583.383616:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789708583.383621:0:5800:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a1410604800 10000000:01000000:0.0:1789708583.383623:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789708583.383627:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789708583.383629:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789708583.383642:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000da65f42c/0xa8f741d1c6865e18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.383672:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000da65f42c/0xa8f741d1c6865e18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.383679:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000da65f42c/0xa8f741d1c6865e18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708583.383692:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426234112:0@lo:101: 00000100:00100000:0.0:1789708583.383718:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708583.383747:0:5800:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a124e29d going to sleep for 11 seconds 00000100:00100000:1.0:1789708583.383805:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426234112 00000100:00100000:1.0:1789708583.383810:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426234112 00000100:00100000:1.0:1789708583.383837:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789708583.383843:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000622d4ddf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+7:5800:x1876645426234112:12345-0@lo:101: 00010000:00010000:1.0:1789708583.383851:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708583.383859:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000739ac9d2/0xa8f741d1c6865e1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865e18 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.383883:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000739ac9d2/0xa8f741d1c6865e1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865e18 expref: 8 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.383891:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000739ac9d2/0xa8f741d1c6865e1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865e18 expref: 8 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.383897:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000739ac9d2, rc 0) 00000100:00100000:1.0:1789708583.383931:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000622d4ddf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+8:5800:x1876645426234112:12345-0@lo:101: Request processed in 85us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708583.383937:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789708583.384146:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426234112:0@lo:101: 00010000:00010000:0.0:1789708583.384156:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000da65f42c/0xa8f741d1c6865e18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e1f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.384163:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000da65f42c/0xa8f741d1c6865e18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865e1f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708583.384204:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426234240:0@lo:501: 00000100:00100000:0.0:1789708583.384228:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708583.384298:0:5800:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a124e29d going to sleep for 11 seconds 00000100:00100000:1.0:1789708583.384332:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426234240 00000100:00100000:1.0:1789708583.384337:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426234240 00000100:00100000:1.0:1789708583.384363:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789708583.384369:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000843fe86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+8:5800:x1876645426234240:12345-0@lo:501: 00000100:00100000:1.0:1789708583.384971:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000843fe86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+9:5800:x1876645426234240:12345-0@lo:501: Request processed in 601us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708583.384980:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789708583.385937:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426234240:0@lo:501: 00000100:00100000:0.0:1789708583.385986:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426234368:0@lo:503: 00000100:00100000:0.0:1789708583.386091:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708583.386131:0:5800:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a124e29d going to sleep for 11 seconds 00000100:00100000:1.0:1789708583.386182:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426234368 00000100:00100000:1.0:1789708583.386187:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426234368 00000100:00100000:1.0:1789708583.386251:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789708583.386258:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c3319134 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+9:5800:x1876645426234368:12345-0@lo:503: 00000100:00100000:1.0:1789708583.386429:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c3319134 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+9:5800:x1876645426234368:12345-0@lo:503: Request processed in 172us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708583.386435:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708583.386493:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426234368:0@lo:503: 00000100:00100000:1.0:1789708583.387610:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000056710152 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:5842:1876645426234496:0@lo:502: 00000100:00100000:1.0:1789708583.387681:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708583.387720:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 000000004a882a83 going to sleep for 11 seconds 00000100:00100000:2.0:1789708583.387780:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426234496 00000100:00100000:2.0:1789708583.387786:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426234496 00000100:00100000:2.0:1789708583.387833:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789708583.387840:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000071ca6c63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+9:5842:x1876645426234496:12345-0@lo:502: 00000100:00100000:2.0:1789708583.387987:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000071ca6c63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+9:5842:x1876645426234496:12345-0@lo:502: Request processed in 148us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708583.387992:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789708583.388161:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000056710152 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:5842:1876645426234496:0@lo:502: 00000020:01000000:3.0:1789708583.388200:0:5842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708583.388212:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708583.388215:0:5842:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789708583.388220:0:5842:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789708583.388224:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789708583.388236:0:5842:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000fbd84433) 00000020:00000080:3.0:1789708583.388253:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789708583.388259:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789708583.388327:0:5842:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789708583.388334:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa8f741d1c6865e2d 00000020:00000080:3.0:1789708583.388753:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789708583.388758:0:5842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708583.388767:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708583.388769:0:5842:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789708583.388773:0:5842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708583.388777:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708583.388778:0:5842:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789708583.388781:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789708583.388788:0:5842:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000009d679e88) 00000020:00000080:3.0:1789708583.388799:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789708583.388803:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789708583.388805:0:5842:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789708583.388808:0:5842:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789708583.388814:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789708583.388864:0:5842:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000051d14b51 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789708583.388884:0:5842:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000907d57a0) 00000020:00000080:3.0:1789708583.388893:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789708583.388961:0:5842:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789708583.388966:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa8f741d1c6865e42 00000020:00000080:3.0:1789708583.389063:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789708583.389070:0:5842:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789708583.389075:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa8f741d1c6865e49 00080000:01000000:3.0:1789708583.389080:0:5842:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789708583.389083:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa8f741d1c6865e50 00080000:10000000:3.0:1789708583.389487:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1789708583.389723:0:5842:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789708583.404992:0:5842:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1789708583.461932:0:5842:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1789708583.462376:0:5842:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789708583.465256:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789708583.465534:0:5842:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789708583.487986:0:5842:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000006ea44097) 00000020:00000080:3.0:1789708583.488760:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789708583.490393:0:5842:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789708583.490408:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa8f741d1c6865e5e 00000020:00000080:3.0:1789708583.494504:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789708583.496186:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789708583.526931:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789708583.551299:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789708583.581447:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789708583.617999:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789708583.650480:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1789708583.680785:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa8f741d1c6865e65 00000020:00000080:0.0:1789708583.681214:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789708583.681225:0:5842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708583.681231:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708583.681233:0:5842:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789708583.681236:0:5842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708583.681240:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708583.681241:0:5842:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789708583.681244:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789708583.681245:0:5842:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789708583.681247:0:5842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708583.681249:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708583.681251:0:5842:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789708583.681253:0:5842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708583.681257:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708583.681258:0:5842:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789708583.681261:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789708583.681294:0:5842:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1789708583.681346:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:5842:1876645426234624:0@lo:502: 00000100:00100000:0.0:1789708583.681428:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708583.681490:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca8205c2 going to sleep for 11 seconds 00000100:00100000:1.0:1789708583.681556:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426234624 00000100:00100000:1.0:1789708583.681572:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426234624 00000100:00100000:1.0:1789708583.681611:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789708583.681618:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000090be8885 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+9:5842:x1876645426234624:12345-0@lo:502: 00000100:00100000:1.0:1789708583.681946:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000090be8885 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+9:5842:x1876645426234624:12345-0@lo:502: Request processed in 328us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708583.681954:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789708583.682188:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:5842:1876645426234624:0@lo:502: 00000020:01000000:0.0:1789708583.682214:0:5842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708583.682219:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708583.682221:0:5842:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1789708583.682224:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789708583.682434:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789708583.682462:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789708583.682482:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000da65f42c/0xa8f741d1c6865e18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e1f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.682493:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000da65f42c/0xa8f741d1c6865e18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e1f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708583.682501:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1410604800 from 1 10000000:01000000:1.0:1789708583.682504:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789708583.682533:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000c576da8f/0xa8f741d1c6865e6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.682542:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000c576da8f/0xa8f741d1c6865e6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.682550:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000c576da8f/0xa8f741d1c6865e6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708583.682863:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e29ea818 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426234752:0@lo:101: 00000100:00100000:3.0:1789708583.682903:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708583.682936:0:5800:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028a891ba going to sleep for 11 seconds 00000100:00100000:1.0:1789708583.683074:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426234752 00000100:00100000:1.0:1789708583.683080:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426234752 00000100:00100000:1.0:1789708583.683121:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789708583.683128:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000021923950 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+9:5800:x1876645426234752:12345-0@lo:101: 00010000:00010000:1.0:1789708583.683139:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708583.683151:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000959d93a9/0xa8f741d1c6865e73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865e6c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.683172:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000959d93a9/0xa8f741d1c6865e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865e6c expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.683181:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000959d93a9/0xa8f741d1c6865e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865e6c expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.683190:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000959d93a9, rc 0) 00000100:00100000:1.0:1789708583.683227:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000021923950 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+10:5800:x1876645426234752:12345-0@lo:101: Request processed in 100us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708583.683233:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708583.683295:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e29ea818 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426234752:0@lo:101: 00010000:00010000:0.0:1789708583.683306:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000c576da8f/0xa8f741d1c6865e6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e73 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.683325:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000c576da8f/0xa8f741d1c6865e6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865e73 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708583.683928:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426234880:0@lo:256: 00000100:00100000:0.0:1789708583.683965:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708583.683989:0:5800:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca8205c2 going to sleep for 11 seconds 00000100:00100000:1.0:1789708583.684181:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426234880 00000100:00100000:1.0:1789708583.684185:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426234880 00000100:00100000:1.0:1789708583.684219:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789708583.684226:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004da9579e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+10:5800:x1876645426234880:12345-0@lo:256: 20000000:01000000:1.0:1789708583.684242:0:5813:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789708583.684248:0:5813:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789708583.684309:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004da9579e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+10:5800:x1876645426234880:12345-0@lo:256: Request processed in 84us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708583.684316:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789708583.684442:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426234880:0@lo:256: 10000000:01000000:0.0:1789708583.685243:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789708583.685304:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000c576da8f/0xa8f741d1c6865e6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e73 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.685314:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000c576da8f/0xa8f741d1c6865e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e73 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708583.685322:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1410604800 from 1 10000000:01000000:0.0:1789708583.685325:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789708583.685353:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000de751b5a/0xa8f741d1c6865e7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.685360:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000de751b5a/0xa8f741d1c6865e7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.685369:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000de751b5a/0xa8f741d1c6865e7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708583.685382:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426235008:0@lo:101: 00000100:00100000:0.0:1789708583.685418:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708583.685460:0:5800:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca8205c2 going to sleep for 11 seconds 00000100:00100000:1.0:1789708583.685517:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426235008 00000100:00100000:1.0:1789708583.685523:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426235008 00000100:00100000:1.0:1789708583.685583:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789708583.685591:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000317dc6a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+10:5800:x1876645426235008:12345-0@lo:101: 00010000:00010000:1.0:1789708583.685601:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708583.685612:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c10bc19/0xa8f741d1c6865e81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865e7a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.685630:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c10bc19/0xa8f741d1c6865e81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865e7a expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.685640:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c10bc19/0xa8f741d1c6865e81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865e7a expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.685676:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c10bc19, rc 0) 00000100:00100000:1.0:1789708583.685710:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000317dc6a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:5800:x1876645426235008:12345-0@lo:101: Request processed in 120us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708583.685716:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789708583.685861:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426235008:0@lo:101: 00010000:00010000:0.0:1789708583.685873:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000de751b5a/0xa8f741d1c6865e7a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e81 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.685881:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000de751b5a/0xa8f741d1c6865e7a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865e81 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708583.685930:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426235136:0@lo:501: 00000100:00100000:0.0:1789708583.685956:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708583.685985:0:5800:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca8205c2 going to sleep for 11 seconds 00000100:00100000:1.0:1789708583.686186:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426235136 00000100:00100000:1.0:1789708583.686191:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426235136 00000100:00100000:1.0:1789708583.686224:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789708583.686231:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005cea4487 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:5800:x1876645426235136:12345-0@lo:501: 00000100:00100000:1.0:1789708583.686943:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005cea4487 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:5800:x1876645426235136:12345-0@lo:501: Request processed in 712us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708583.686952:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789708583.687171:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d0ceb3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426235136:0@lo:501: 00000100:00100000:2.0:1789708583.687228:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003339d17e pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426235264:0@lo:503: 00000100:00100000:2.0:1789708583.687273:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708583.687339:0:5800:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d41d209c going to sleep for 11 seconds 00000100:00100000:1.0:1789708583.687380:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426235264 00000100:00100000:1.0:1789708583.687385:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426235264 00000100:00100000:1.0:1789708583.687447:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789708583.687454:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000594edc03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:5800:x1876645426235264:12345-0@lo:503: 00000040:00080000:1.0:1789708583.687497:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789708583.687586:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000594edc03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:5800:x1876645426235264:12345-0@lo:503: Request processed in 133us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708583.687593:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789708583.687790:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003339d17e pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426235264:0@lo:503: 00000040:00080000:3.0:1789708583.688962:0:5846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789708583.689228:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789708583.689256:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789708583.689298:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000de751b5a/0xa8f741d1c6865e7a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e81 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.689309:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000de751b5a/0xa8f741d1c6865e7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e81 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708583.689356:0:5800:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789708583.689359:0:5800:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a1410604800 10000000:01000000:1.0:1789708583.689362:0:5800:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a1410604800 10000000:01000000:1.0:1789708583.689367:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789708583.689373:0:5800:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1410604800 from 1 10000000:01000000:1.0:1789708583.689375:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789708583.689403:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000be1fef36/0xa8f741d1c6865e88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.689410:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000be1fef36/0xa8f741d1c6865e88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.689421:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000be1fef36/0xa8f741d1c6865e88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708583.689437:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6fecd08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426235392:0@lo:101: 00000100:00100000:1.0:1789708583.689480:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708583.689522:0:5800:0:(client.c:2716:ptlrpc_set_wait()) set 000000003aea1343 going to sleep for 11 seconds 00000100:00100000:0.0:1789708583.689639:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426235392 00000100:00100000:0.0:1789708583.689646:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426235392 00000100:00100000:0.0:1789708583.689738:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789708583.689744:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005d3ccec7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:5800:x1876645426235392:12345-0@lo:101: 00010000:00010000:0.0:1789708583.689755:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708583.689766:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000038f71220/0xa8f741d1c6865e8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865e88 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.689785:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038f71220/0xa8f741d1c6865e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865e88 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.689793:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000038f71220/0xa8f741d1c6865e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865e88 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.689801:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000038f71220, rc 0) 00000100:00100000:0.0:1789708583.689836:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005d3ccec7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:5800:x1876645426235392:12345-0@lo:101: Request processed in 92us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708583.689842:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789708583.689931:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6fecd08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426235392:0@lo:101: 00010000:00010000:2.0:1789708583.689944:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000be1fef36/0xa8f741d1c6865e88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e8f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708583.689952:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000be1fef36/0xa8f741d1c6865e88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865e8f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708583.690075:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003339d17e pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426235520:0@lo:501: 00000100:00100000:2.0:1789708583.690113:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708583.690149:0:5800:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d41d209c going to sleep for 11 seconds 00000100:00100000:0.0:1789708583.690200:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426235520 00000100:00100000:0.0:1789708583.690205:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426235520 00000100:00100000:0.0:1789708583.690236:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789708583.690242:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ebe75c15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:5800:x1876645426235520:12345-0@lo:501: 00000100:00100000:0.0:1789708583.690467:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ebe75c15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:5800:x1876645426235520:12345-0@lo:501: Request processed in 226us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708583.690475:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789708583.690505:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003339d17e pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426235520:0@lo:501: 00000100:00100000:0.0:1789708583.690539:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea47763b pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426235648:0@lo:503: 00000100:00100000:0.0:1789708583.690687:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708583.690704:0:5800:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e86d7b74 going to sleep for 11 seconds 00000100:00100000:0.0:1789708583.690724:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426235648 00000100:00100000:0.0:1789708583.690728:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426235648 00000100:00100000:0.0:1789708583.690745:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789708583.690750:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f6475b02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:5800:x1876645426235648:12345-0@lo:503: 00000100:00100000:0.0:1789708583.691130:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f6475b02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:5800:x1876645426235648:12345-0@lo:503: Request processed in 379us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708583.691137:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789708583.691172:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea47763b pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426235648:0@lo:503: 00000100:00100000:0.0:1789708583.691377:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea47763b pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:5847:1876645426235776:0@lo:502: 00000100:00100000:0.0:1789708583.691411:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708583.691431:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426235776 00000100:00100000:0.0:1789708583.691435:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426235776 00000100:00100000:0.0:1789708583.691453:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789708583.691458:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f243bee6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:5847:x1876645426235776:12345-0@lo:502: 00000100:00100000:0.0:1789708583.692132:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f243bee6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:5847:x1876645426235776:12345-0@lo:502: Request processed in 673us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708583.692146:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789708583.693399:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set 00000000367cd02a going to sleep for 11 seconds 00000100:00100000:0.0:1789708583.693426:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea47763b pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:5847:1876645426235776:0@lo:502: 00000020:01000004:0.0:1789708583.693492:0:5847:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789708583.693518:0:5847:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000153d48e0) 00000020:00000080:0.0:1789708583.693538:0:5847:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789708583.694385:0:5847:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000051d14b51 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789708583.694391:0:5847:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000051d14b51 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789708583.694394:0:5847:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000051d14b51 4 00010000:00080000:0.0:1789708583.694425:0:5847:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f751ed5c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:0.0:1789708583.698257:0:5847:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789708583.698516:0:5847:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789708583.698556:0:5847:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789708583.698579:0:5847:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa8f741d1c6865e9d 00000100:00080000:0.0:1789708583.698588:0:5847:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789708583.698598:0:5847:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f751ed5c using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1789708583.698629:0:5847:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ea47763b x1876645426235904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789708583.698677:0:5847:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789708583.698989:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea47763b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876645426235904:0@lo:38: 00000100:00100000:1.0:1789708583.699068:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708583.699208:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426235904 00000100:00100000:3.0:1789708583.699216:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426235904 00000100:00100000:3.0:1789708583.699247:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708583.699253:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000224a81c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1876645426235904:12345-0@lo:38: 00000100:00100000:3.0:1789708583.699300:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000224a81c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1876645426235904:12345-0@lo:38: Request processed in 47us (234us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789708583.699307:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789708583.699370:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789708583.699377:0:3285:0:(import.c:65:import_set_state_nolock()) 00000000f751ed5c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789708583.699381:0:3285:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789708583.699384:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea47763b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876645426235904:0@lo:38: 00000100:00100000:0.0:1789708583.699488:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007823304c pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:5847:1876645426236032:0@lo:502: 00000100:00100000:0.0:1789708583.699531:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708583.699553:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set 00000000367cd02a going to sleep for 11 seconds 00000100:00100000:1.0:1789708583.699743:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426236032 00000100:00100000:1.0:1789708583.699747:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426236032 00000100:00100000:1.0:1789708583.699779:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789708583.699784:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002162c53b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:5847:x1876645426236032:12345-0@lo:502: 00000100:00100000:1.0:1789708583.699985:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002162c53b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:5847:x1876645426236032:12345-0@lo:502: Request processed in 201us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708583.700052:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789708583.700150:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007823304c pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:5847:1876645426236032:0@lo:502: 00000040:00080000:0.0:1789708583.700170:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1789708583.700311:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1789708583.700337:0:5800:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789708583.700355:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000be1fef36/0xa8f741d1c6865e88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e8f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708583.700365:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000be1fef36/0xa8f741d1c6865e88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e8f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789708583.700408:0:5800:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789708583.700411:0:5800:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789708583.700412:0:5800:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708583.700413:0:5800:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708583.700414:0:5800:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708583.700415:0:5800:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708583.700417:0:5800:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789708583.700418:0:5800:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789708583.700423:0:5800:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789708583.700424:0:5800:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789708583.700426:0:5800:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708583.700427:0:5800:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789708583.700430:0:5800:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1789708583.700433:0:5800:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789708583.700434:0:5800:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789708583.700435:0:5800:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708583.700436:0:5800:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708583.700437:0:5800:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708583.700438:0:5800:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708583.700439:0:5800:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789708583.700440:0:5800:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789708583.700440:0:5800:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789708583.700441:0:5800:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789708583.700442:0:5800:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708583.700443:0:5800:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789708583.700461:0:5800:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789708583.700468:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084320470 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426236160:0@lo:253: 00000100:00100000:1.0:1789708583.700497:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708583.700521:0:5800:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f7349c4 going to sleep for 11 seconds 00000100:00100000:0.0:1789708583.700583:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426236160 00000100:00100000:0.0:1789708583.700587:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426236160 00000100:00100000:0.0:1789708583.700618:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789708583.700623:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000be9e312e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:5800:x1876645426236160:12345-0@lo:253: 20000000:01000000:0.0:1789708583.700823:0:5814:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789708583.700839:0:5814:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789708583.730840:0:5814:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789708583.730860:0:5814:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789708583.731682:0:5835:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789708583.731689:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789708583.731713:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000066d0093c/0xa8f741d1c6865ea4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708583.731737:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000959d93a9/0xa8f741d1c6865e73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865e6c expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708583.731746:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000066d0093c/0xa8f741d1c6865ea4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708583.731795:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000959d93a9/0xa8f741d1c6865e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6865e6c expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708583.731809:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000959d93a9/0xa8f741d1c6865e73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6865e6c expref: 12 pid: 5812 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708583.731823:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6d4c478 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5835:1876645426236288:0@lo:104: 00000100:00100000:3.0:1789708583.731885:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708583.731940:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d860c93 going to sleep for 11 seconds 00000100:00100000:0.0:1789708583.732063:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426236288 00000100:00100000:0.0:1789708583.732071:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426236288 00000100:00100000:0.0:1789708583.732128:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708583.732136:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ff305ae7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:5835:x1876645426236288:12345-0@lo:104: 00010000:00010000:0.0:1789708583.732149:0:5802:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: 00000000c576da8f/0xa8f741d1c6865e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865e73 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732206:0:5802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789708583.732212:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ff305ae7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:5835:x1876645426236288:12345-0@lo:104: Request processed in 77us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708583.732219:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708583.732257:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6d4c478 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5835:1876645426236288:0@lo:104: 00010000:00010000:0.0:1789708583.732274:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000066d0093c/0xa8f741d1c6865ea4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732291:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708583.732296:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: 00000000c576da8f/0xa8f741d1c6865e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865e73 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732303:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c576da8f already unused, calling callback (00000000d4d2c9a4) 10000000:00010000:0.0:1789708583.732306:0:5807:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: 00000000c576da8f/0xa8f741d1c6865e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6865e73 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732325:0:5807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: 00000000c576da8f/0xa8f741d1c6865e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6865e73 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708583.732332:0:5807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: 00000000c576da8f/0xa8f741d1c6865e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6865e73 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708583.732338:0:5807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789708583.732367:0:5807:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: 00000000c576da8f/0xa8f741d1c6865e6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865e73 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732375:0:5807:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708583.732394:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: 00000000c576da8f/0xa8f741d1c6865e6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865e73 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732401:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: 00000000c576da8f/0xa8f741d1c6865e6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865e73 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732418:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708583.732420:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708583.732421:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708583.732480:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007823304c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426236416:0@lo:103: 00000100:00100000:0.0:1789708583.732509:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708583.732544:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426236416 00000100:00100000:0.0:1789708583.732549:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426236416 00010000:00010000:0.0:1789708583.732578:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000959d93a9/0xa8f741d1c6865e73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865e6c expref: 13 pid: 5812 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708583.732601:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708583.732607:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bf3bee8c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:3287:x1876645426236416:12345-0@lo:103: 00010000:00010000:0.0:1789708583.732625:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708583.732630:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000959d93a9/0xa8f741d1c6865e73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865e6c expref: 13 pid: 5812 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732639:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000959d93a9/0xa8f741d1c6865e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6865e6c expref: 13 pid: 5812 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732684:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000959d93a9/0xa8f741d1c6865e73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6865e6c expref: 13 pid: 5812 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732697:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000066d0093c/0xa8f741d1c6865ea4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732705:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000066d0093c/0xa8f741d1c6865ea4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789708583.732718:0:5804:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001030357s 00010000:00010000:0.0:1789708583.732721:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000066d0093c/0xa8f741d1c6865ea4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732729:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000066d0093c/0xa8f741d1c6865ea4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732735:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000066d0093c/0xa8f741d1c6865ea4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732740:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000066d0093c/0xa8f741d1c6865ea4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732745:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000066d0093c already unused, calling callback (0000000035918db3) 00010000:00010000:0.0:1789708583.732748:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000066d0093c/0xa8f741d1c6865ea4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732760:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000066d0093c/0xa8f741d1c6865ea4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732773:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000066d0093c/0xa8f741d1c6865ea4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732782:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708583.732811:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bf3bee8c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:3287:x1876645426236416:12345-0@lo:103: Request processed in 204us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708583.732819:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789708583.732840:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000066d0093c/0xa8f741d1c6865ea4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732846:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000066d0093c/0xa8f741d1c6865ea4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708583.732852:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000066d0093c/0xa8f741d1c6865ea4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708583.732875:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007823304c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426236416:0@lo:103: 00000100:00100000:0.0:1789708583.740068:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000be9e312e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:5800:x1876645426236160:12345-0@lo:253: Request processed in 39368us (39494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708583.740088:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789708583.740183:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084320470 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:5800:1876645426236160:0@lo:253: 10000000:01000000:1.0:1789708583.740198:0:5800:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789708583.740201:0:5800:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789708583.740203:0:5800:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789708583.740204:0:5800:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708583.740205:0:5800:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708583.740206:0:5800:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708583.740208:0:5800:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708583.740209:0:5800:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789708583.740210:0:5800:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789708583.740211:0:5800:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789708583.740213:0:5800:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789708583.740214:0:5800:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708583.740216:0:5800:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789708583.740244:0:5800:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789708583.745590:0:5800:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789708583.745988:0:5800:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789708583.746784:0:5800:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789708583.746954:0:5800:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789708583.747338:0:5800:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789708583.747531:0:5800:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789708583.748459:0:5800:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789708583.748953:0:5800:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789708583.749277:0:5800:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789708583.749463:0:5800:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789708583.749835:0:5800:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789708583.750153:0:5800:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789708583.786638:0:5800:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789708583.821044:0:5800:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789708583.821240:0:5852:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789708583.821244:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789708583.821418:0:5853:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789708583.826003:0:5800:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789708583.826292:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789708583.826974:0:5800:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789708583.826984:0:5800:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789708583.827258:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789708583.828527:0:5800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789708583.829036:0:5800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789708583.829085:0:5800:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789708583.829416:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789708583.829571:0:5800:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1789708583.830745:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789708583.830880:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789708583.832318:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789708583.832515:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789708583.833092:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789708583.833238:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789708583.833392:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789708583.833532:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789708583.833751:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789708583.834286:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789708583.834445:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789708583.834646:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789708583.834828:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789708583.834941:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789708583.835188:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789708583.835300:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789708583.835540:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789708583.835886:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789708583.836137:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789708583.836270:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789708583.836415:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789708583.836538:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789708583.836798:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789708583.836928:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789708583.837620:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789708583.838982:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789708583.840151:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789708583.840309:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789708583.840472:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789708583.840599:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789708583.840759:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789708583.840907:0:5800:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789708583.842597:0:5800:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1789708583.864590:0:5853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1789708583.919982:0:5800:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789708583.920016:0:5800:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa44901dcb988 00100000:10000000:2.0:1789708583.920022:0:5800:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789708583.920768:0:5800:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789708583.920783:0:5800:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789708583.920802:0:5800:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1789708583.920828:0:5800:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1789708583.924554:0:5853:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789708583.924631:0:5853:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789708583.924635:0:5853:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1789708584.060299:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708585.082862:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708586.106748:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789708586.478190:0:6096:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789708587.133553:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708588.154793:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708588.795253:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d39090a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426236544:0@lo:400: 00000100:00100000:2.0:1789708588.795323:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789708588.795337:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789708588.795342:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789708588.795345:0:38:0:(import.c:65:import_set_state_nolock()) 00000000f751ed5c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1789708588.795413:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426236544 00000100:00100000:0.0:1789708588.795421:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426236544 00000100:00100000:0.0:1789708588.795470:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789708588.795478:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005d282e06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:3288:x1876645426236544:12345-0@lo:400: 00000100:00080000:3.0:1789708588.795562:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f751ed5c using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1789708588.795584:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000039ebdefd x1876645426236672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789708588.795626:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039ebdefd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876645426236672:0@lo:38: 00000100:00100000:1.0:1789708588.795692:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708588.795711:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005d282e06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:3288:x1876645426236544:12345-0@lo:400: Request processed in 234us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708588.795719:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789708588.795752:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426236672 00000100:00100000:0.0:1789708588.795756:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426236672 00000100:00100000:0.0:1789708588.795788:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708588.795792:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084320470 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1876645426236672:12345-0@lo:38: 00010000:00080000:0.0:1789708588.795812:0:5821:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:0.0:1789708588.795844:0:5821:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa8f741d1c6865eab 00000004:00100000:0.0:1789708588.795886:0:5821:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789708588.796095:0:5821:0:(import.c:65:import_set_state_nolock()) 00000000f5fd0de9 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708588.796135:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084320470 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876645426236672:12345-0@lo:38: Request processed in 342us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708588.796140:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789708588.796357:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000039ebdefd x1876645426236672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789708588.796368:0:3285:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789708588.796373:0:3285:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789708588.796377:0:3285:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789708588.796378:0:3285:0:(import.c:65:import_set_state_nolock()) 00000000f751ed5c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789708588.796381:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039ebdefd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876645426236672:0@lo:38: 00000100:00100000:2.0:1789708588.796426:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d39090a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426236544:0@lo:400: 00010000:00010000:0.0:1789708589.179896:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789708589.649090:0:6297:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe1440a30 20000000:00000080:1.0:1789708589.649107:0:6297:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a143e1cc400 uarg=0000000000000000 20000000:01000000:1.0:1789708589.649146:0:6297:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789708589.649154:0:6297:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789708589.649161:0:6297:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789708589.649390:0:6297:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789708589.649404:0:6297:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1789708589.652460:0:6297:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789708589.652954:0:6297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789708589.653016:0:6297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789708589.653099:0:6297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789708589.653124:0:6297:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789708589.653142:0:6297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003b650196/0xa8f741d1c6865eb2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708589.653160:0:6297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003c10bc19/0xa8f741d1c6865e81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865e7a expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708589.653167:0:6297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003b650196/0xa8f741d1c6865eb2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708589.653205:0:6297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003c10bc19/0xa8f741d1c6865e81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6865e7a expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708589.653218:0:6297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003c10bc19/0xa8f741d1c6865e81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6865e7a expref: 10 pid: 5813 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708589.653230:0:6297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e18af90b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6297:1876645426236800:0@lo:104: 00000100:00100000:2.0:1789708589.653294:0:6297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708589.653347:0:6297:0:(client.c:2716:ptlrpc_set_wait()) set 00000000acd81338 going to sleep for 11 seconds 00000100:00100000:3.0:1789708589.653406:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426236800 00000100:00100000:3.0:1789708589.653414:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426236800 00000100:00100000:3.0:1789708589.653459:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789708589.653465:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006c0d643c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:6297:x1876645426236800:12345-0@lo:104: 00010000:00010000:3.0:1789708589.653474:0:5802:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: 00000000de751b5a/0xa8f741d1c6865e7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865e81 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708589.653523:0:5802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789708589.653528:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006c0d643c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:6297:x1876645426236800:12345-0@lo:104: Request processed in 64us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708589.653535:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789708589.653580:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708589.653585:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: 00000000de751b5a/0xa8f741d1c6865e7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865e81 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708589.653591:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000de751b5a already unused, calling callback (00000000d4d2c9a4) 10000000:00010000:1.0:1789708589.653594:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: 00000000de751b5a/0xa8f741d1c6865e7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6865e81 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708589.653600:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: 00000000de751b5a/0xa8f741d1c6865e7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6865e81 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708589.653606:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: 00000000de751b5a/0xa8f741d1c6865e7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6865e81 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708589.653611:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789708589.653643:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: 00000000de751b5a/0xa8f741d1c6865e7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865e81 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708589.653684:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789708589.653698:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: 00000000de751b5a/0xa8f741d1c6865e7a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865e81 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708589.653705:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: 00000000de751b5a/0xa8f741d1c6865e7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865e81 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708589.653731:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708589.653732:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708589.653734:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708589.653743:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000086d93f34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426236928:0@lo:103: 00000100:00100000:1.0:1789708589.653764:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708589.653797:0:6297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e18af90b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6297:1876645426236800:0@lo:104: 00010000:00010000:1.0:1789708589.653808:0:6297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003b650196/0xa8f741d1c6865eb2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708589.653906:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426236928 00000100:00100000:2.0:1789708589.653911:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426236928 00010000:00010000:2.0:1789708589.653923:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003c10bc19/0xa8f741d1c6865e81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865e7a expref: 11 pid: 5813 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708589.653947:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789708589.653953:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000016d2b9d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:3289:x1876645426236928:12345-0@lo:103: 00010000:00010000:2.0:1789708589.653962:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708589.653966:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003c10bc19/0xa8f741d1c6865e81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865e7a expref: 11 pid: 5813 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708589.653975:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003c10bc19/0xa8f741d1c6865e81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6865e7a expref: 11 pid: 5813 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708589.653986:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003c10bc19/0xa8f741d1c6865e81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6865e7a expref: 11 pid: 5813 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708589.653995:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003b650196/0xa8f741d1c6865eb2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708589.654000:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b650196/0xa8f741d1c6865eb2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708589.654008:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003b650196/0xa8f741d1c6865eb2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708589.654012:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003b650196/0xa8f741d1c6865eb2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708589.654015:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003b650196/0xa8f741d1c6865eb2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708589.654023:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003b650196/0xa8f741d1c6865eb2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708589.654026:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003b650196 already unused, calling callback (0000000035918db3) 00010000:00010000:2.0:1789708589.654028:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003b650196/0xa8f741d1c6865eb2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708589.654033:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003b650196/0xa8f741d1c6865eb2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708589.654054:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003b650196/0xa8f741d1c6865eb2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708589.654063:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708589.654091:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000016d2b9d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34efb293-a6d4-48d2-a113-9ec9a49feb73+10:3289:x1876645426236928:12345-0@lo:103: Request processed in 139us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708589.654097:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789708589.654120:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000086d93f34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426236928:0@lo:103: 00010000:00010000:1.0:1789708589.654162:0:6297:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003b650196/0xa8f741d1c6865eb2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708589.654168:0:6297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003b650196/0xa8f741d1c6865eb2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708589.654171:0:6297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003b650196/0xa8f741d1c6865eb2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708590.074923:0:5816:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789708590.074929:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1410604800 from 3 10000000:01000000:0.0:1789708590.074933:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789708590.074972:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000ce106dc8/0xa8f741d1c6865eb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708590.074983:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000ce106dc8/0xa8f741d1c6865eb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708590.074992:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000ce106dc8/0xa8f741d1c6865eb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708590.075014:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007823304c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426237056:0@lo:101: 00000100:00100000:0.0:1789708590.075097:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708590.075151:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dd8209ce going to sleep for 11 seconds 00000100:00100000:2.0:1789708590.075300:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426237056 00000100:00100000:2.0:1789708590.075309:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426237056 00000100:00100000:2.0:1789708590.075363:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789708590.075370:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e7c39f40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+10:5816:x1876645426237056:12345-0@lo:101: 00010000:00010000:2.0:1789708590.075382:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708590.075395:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000081854f25/0xa8f741d1c6865ec0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865eb9 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708590.075415:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000081854f25/0xa8f741d1c6865ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865eb9 expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708590.075436:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000081854f25/0xa8f741d1c6865ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865eb9 expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708590.075445:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000081854f25, rc 0) 00000100:00100000:2.0:1789708590.075481:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e7c39f40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:5816:x1876645426237056:12345-0@lo:101: Request processed in 112us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708590.075488:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789708590.075597:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007823304c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426237056:0@lo:101: 00010000:00010000:0.0:1789708590.075610:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000ce106dc8/0xa8f741d1c6865eb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865ec0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708590.075629:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000ce106dc8/0xa8f741d1c6865eb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865ec0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708590.075687:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007823304c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426237184:0@lo:256: 00000100:00100000:0.0:1789708590.075715:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708590.075736:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dd8209ce going to sleep for 11 seconds 00000100:00100000:3.0:1789708590.075820:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426237184 00000100:00100000:3.0:1789708590.075825:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426237184 00000100:00100000:3.0:1789708590.075856:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789708590.075863:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000072c7fdf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:5816:x1876645426237184:12345-0@lo:256: 20000000:01000000:3.0:1789708590.075877:0:5813:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789708590.075891:0:5813:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789708590.075894:0:5813:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789708590.075969:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000072c7fdf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:5816:x1876645426237184:12345-0@lo:256: Request processed in 106us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708590.075980:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789708590.076012:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007823304c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426237184:0@lo:256: 10000000:01000000:3.0:1789708590.076062:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789708590.076067:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000ce106dc8/0xa8f741d1c6865eb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865ec0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708590.076076:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000ce106dc8/0xa8f741d1c6865eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865ec0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708590.076138:0:5816:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789708590.076140:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1410604800 from 1 10000000:01000000:3.0:1789708590.076143:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708590.076161:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000c633a99e/0xa8f741d1c6865ec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708590.076168:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000c633a99e/0xa8f741d1c6865ec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708590.076175:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000c633a99e/0xa8f741d1c6865ec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708590.076185:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d2b9e9d0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426237312:0@lo:101: 00000100:00100000:3.0:1789708590.076209:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708590.076228:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000953b5c03 going to sleep for 11 seconds 00000100:00100000:3.0:1789708590.076239:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426237312 00000100:00100000:3.0:1789708590.076242:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426237312 00000100:00100000:3.0:1789708590.076257:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789708590.076262:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a6fda5aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:5816:x1876645426237312:12345-0@lo:101: 00010000:00010000:3.0:1789708590.076275:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708590.076283:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e236c25b/0xa8f741d1c6865ece lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865ec7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708590.076296:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e236c25b/0xa8f741d1c6865ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865ec7 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708590.076303:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e236c25b/0xa8f741d1c6865ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865ec7 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708590.076309:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e236c25b, rc 0) 00000100:00100000:3.0:1789708590.076334:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a6fda5aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:5816:x1876645426237312:12345-0@lo:101: Request processed in 72us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708590.076340:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789708590.076366:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d2b9e9d0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426237312:0@lo:101: 00010000:00010000:3.0:1789708590.076374:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000c633a99e/0xa8f741d1c6865ec7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865ece expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708590.076380:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000c633a99e/0xa8f741d1c6865ec7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865ece expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708590.076419:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d2b9e9d0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426237440:0@lo:501: 00000100:00100000:3.0:1789708590.076441:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708590.076453:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000953b5c03 going to sleep for 11 seconds 00000100:00100000:3.0:1789708590.076463:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426237440 00000100:00100000:3.0:1789708590.076466:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426237440 00000100:00100000:3.0:1789708590.076482:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789708590.076486:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000177463a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:5816:x1876645426237440:12345-0@lo:501: 00000100:00100000:3.0:1789708590.076733:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000177463a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:5816:x1876645426237440:12345-0@lo:501: Request processed in 246us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708590.076740:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789708590.076763:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d2b9e9d0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426237440:0@lo:501: 00000100:00100000:3.0:1789708590.076794:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d2b9e9d0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426237568:0@lo:503: 00000100:00100000:3.0:1789708590.076829:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708590.076840:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000953b5c03 going to sleep for 11 seconds 00000100:00100000:3.0:1789708590.076851:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426237568 00000100:00100000:3.0:1789708590.076854:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426237568 00000100:00100000:3.0:1789708590.076870:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789708590.076874:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c16ad7b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:5816:x1876645426237568:12345-0@lo:503: 00000100:00100000:3.0:1789708590.076991:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c16ad7b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:5816:x1876645426237568:12345-0@lo:503: Request processed in 116us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708590.076997:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789708590.077027:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d2b9e9d0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426237568:0@lo:503: 00000100:00100000:1.0:1789708590.079955:0:6316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000948b710b pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:6316:1876645426237696:0@lo:502: 00000100:00100000:1.0:1789708590.080035:0:6316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708590.080097:0:6316:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba5c7a13 going to sleep for 11 seconds 00000100:00100000:0.0:1789708590.080168:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426237696 00000100:00100000:0.0:1789708590.080174:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426237696 00000100:00100000:0.0:1789708590.080218:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789708590.080225:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000005dbead5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:6316:x1876645426237696:12345-0@lo:502: 00000100:00100000:0.0:1789708590.080419:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000005dbead5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:6316:x1876645426237696:12345-0@lo:502: Request processed in 194us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708590.080426:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789708590.080566:0:6316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000948b710b pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:6316:1876645426237696:0@lo:502: 00000020:01000000:1.0:1789708590.080594:0:6316:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708590.080603:0:6316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708590.080605:0:6316:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789708590.080613:0:6316:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1410604800 00000020:00000080:1.0:1789708590.080615:0:6316:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789708590.080688:0:6316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427033100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:6316:1876645426237824:0@lo:502: 00000100:00100000:1.0:1789708590.080721:0:6316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708590.080737:0:6316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405008600 going to sleep for 11 seconds 00000100:00100000:0.0:1789708590.080784:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426237824 00000100:00100000:0.0:1789708590.080788:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426237824 00000100:00100000:0.0:1789708590.080818:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789708590.080825:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:6316:x1876645426237824:12345-0@lo:502: 00000100:00100000:0.0:1789708590.080921:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:6316:x1876645426237824:12345-0@lo:502: Request processed in 97us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708590.080928:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789708590.081609:0:6316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427033100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:6316:1876645426237824:0@lo:502: 00000020:01000000:1.0:1789708590.081631:0:6316:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708590.081636:0:6316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708590.081638:0:6316:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789708590.081642:0:6316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789708590.082608:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789708590.082637:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789708590.082670:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401691c00/0xa8f741d1c6865ec7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865ece expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708590.082682:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1401691c00/0xa8f741d1c6865ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865ece expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708590.204825:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708591.229048:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708592.253932:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708593.274887:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789708593.567576:0:6668:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789708593.567579:0:6668:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789708593.567742:0:6668:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a143fa6b000 00000020:01000004:2.0:1789708593.567760:0:6668:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789708593.567771:0:6668:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789708593.567792:0:6668:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a1402f799c0) 00000020:00000080:2.0:1789708593.567807:0:6668:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789708593.578891:0:6668:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789708593.579172:0:6668:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789708593.593859:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789708593.597961:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789708593.597999:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789708593.598074:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789708593.598103:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789708593.598520:0:6668:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789708593.598534:0:6668:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789708593.598547:0:6668:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa8f741d1c6865edc 00000020:01000004:2.0:1789708593.598556:0:6668:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789708593.598581:0:6668:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.153@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789708593.598590:0:6668:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789708593.598598:0:6668:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789708593.598603:0:6668:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789708593.598616:0:6668:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a1402f7cd40) 00000020:00000080:2.0:1789708593.598629:0:6668:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789708593.601108:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708593.601342:0:6668:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789708593.601358:0:6668:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789708593.608094:0:6668:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789708593.608117:0:6668:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789708593.608968:0:6668:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789708593.608976:0:6668:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789708593.612935:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708593.613204:0:6668:0:(service.c:3474:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789708593.613210:0:6668:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789708593.614104:0:6668:0:(service.c:3474:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789708593.614112:0:6668:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789708593.655706:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708593.656095:0:6668:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789708593.656104:0:6668:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789708593.659372:0:6668:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789708593.659387:0:6668:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789708593.661204:0:6668:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789708593.661226:0:6668:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789708593.665872:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708593.666067:0:6668:0:(service.c:3474:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789708593.666072:0:6668:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789708593.667275:0:6668:0:(service.c:3474:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789708593.667296:0:6668:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789708593.728074:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708593.728920:0:6668:0:(service.c:3474:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789708593.728930:0:6668:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789708593.730802:0:6668:0:(service.c:3474:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789708593.730815:0:6668:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789708593.731284:0:6668:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789708593.731316:0:6668:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789708593.731323:0:6668:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789708593.744282:0:6668:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789708593.744313:0:6668:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.153@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789708593.744316:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789708593.744318:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789708593.744319:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708593.744320:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708593.744323:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708593.744323:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708593.744324:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789708593.744325:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789708593.744326:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789708593.744327:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708593.744328:0:6668:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789708593.744331:0:6668:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789708593.744333:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789708593.744333:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789708593.744334:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708593.744335:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708593.744335:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708593.744336:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708593.744336:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789708593.744337:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789708593.744338:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789708593.744338:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708593.744339:0:6668:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789708593.744367:0:6668:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789708593.744380:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426237952:0@lo:253: 00000100:00100000:3.0:1789708593.744440:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708593.744517:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140ae81540 going to sleep for 11 seconds 00000100:00100000:1.0:1789708593.744559:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426237952 00000100:00100000:1.0:1789708593.744566:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426237952 00000100:00100000:1.0:1789708593.744622:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789708593.744631:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:6668:x1876645426237952:12345-0@lo:253: 20000000:01000000:1.0:1789708593.744776:0:5812:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789708593.744780:0:5812:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789708593.744785:0:5812:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789708593.744788:0:5812:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789708593.745362:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708593.745486:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789708593.745495:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789708593.745517:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1789708593.745532:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789708593.745551:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1789708593.745584:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1789708593.745972:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789708593.745985:0:5812:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.153@tcp 20000000:01000000:1.0:1789708593.745986:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:1.0:1789708593.746021:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789708593.746027:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789708593.746066:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789708593.746071:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:1.0:1789708593.746091:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789708593.746096:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789708593.746111:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789708593.746137:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1789708593.746644:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789708593.746687:0:5812:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.153@tcp 20000000:01000000:1.0:1789708593.746689:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:1.0:1789708593.746720:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789708593.746725:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789708593.746742:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789708593.746746:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:1.0:1789708593.746783:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789708593.746791:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789708593.746831:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1789708593.746850:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1789708593.746865:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1789708593.746867:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1789708593.746871:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789708593.746872:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789708593.746873:0:5812:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789708593.746883:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789708593.746889:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789708593.746910:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789708593.746911:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789708593.747267:0:6683:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1789708593.747296:0:6683:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1789708593.747322:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789708593.747487:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1789708593.747510:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1789708593.747527:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1789708593.747539:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789708593.747540:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789708593.748026:0:6684:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789708593.748070:0:6684:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789708593.748121:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789708593.748347:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789708593.748369:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789708593.748399:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1789708593.748413:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789708593.748414:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789708593.748984:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1789708593.749244:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1789708593.749285:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1789708593.749344:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:3.0:1789708593.749369:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789708593.749389:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865eea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.749407:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a14013a1800/0xa8f741d1c6865e03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865dfc expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.749424:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a14013a0c00/0xa8f741d1c6865e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865e18 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.749431:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1400031600/0xa8f741d1c6865e8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865e88 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.749438:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865eea lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.749474:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1400031600/0xa8f741d1c6865e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6865e88 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.749486:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1400031600/0xa8f741d1c6865e8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6865e88 expref: 12 pid: 5812 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708593.749499:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1876645426238080:0@lo:104: 00000100:00100000:3.0:1789708593.749557:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708593.749699:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a14013a0c00/0xa8f741d1c6865e1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6865e18 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.749707:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a14013a0c00/0xa8f741d1c6865e1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6865e18 expref: 12 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708593.749716:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1876645426238208:0@lo:104: 00000100:00100000:3.0:1789708593.749738:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708593.749862:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a14013a1800/0xa8f741d1c6865e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6865dfc expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.749870:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a14013a1800/0xa8f741d1c6865e03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6865dfc expref: 12 pid: 5812 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708593.749886:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037ba680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1876645426238336:0@lo:104: 00000100:00100000:3.0:1789708593.749910:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708593.749930:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426238080 00000100:00100000:0.0:1789708593.749938:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426238080 00000100:00100000:2.0:1789708593.749949:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426238208 00000100:00100000:2.0:1789708593.749953:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426238208 00000100:00100000:2.0:1789708593.749972:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789708593.749980:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+4:5812:x1876645426238080:12345-0@lo:104: 00010000:00010000:2.0:1789708593.749997:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a14013a0a00/0xa8f741d1c6865e88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865e8f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.750062:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789708593.750064:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140ae81e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708593.750077:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+4:5812:x1876645426238080:12345-0@lo:104: Request processed in 90us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708593.750084:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708593.750086:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1876645426238080:0@lo:104: 00000100:00100000:2.0:1789708593.750097:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426238336 00000100:00100000:2.0:1789708593.750100:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426238336 00010000:00010000:1.0:1789708593.750137:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708593.750144:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a14013a0a00/0xa8f741d1c6865e88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865e8f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.750150:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14013a0a00 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:1.0:1789708593.750154:0:5807:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a14013a0a00/0xa8f741d1c6865e88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6865e8f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.750161:0:5807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a14013a0a00/0xa8f741d1c6865e88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6865e8f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708593.750167:0:5807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a14013a0a00/0xa8f741d1c6865e88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6865e8f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708593.750173:0:5807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789708593.750209:0:5807:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a14013a0a00/0xa8f741d1c6865e88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865e8f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.750215:0:5807:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789708593.750233:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a14013a0a00/0xa8f741d1c6865e88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865e8f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.750240:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a14013a0a00/0xa8f741d1c6865e88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865e8f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.750258:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708593.750260:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708593.750261:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708593.750274:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426238464:0@lo:103: 00000100:00100000:1.0:1789708593.750302:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708593.750348:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426238464 00000100:00100000:1.0:1789708593.750352:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426238464 00010000:00010000:1.0:1789708593.750368:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1400031600/0xa8f741d1c6865e8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865e88 expref: 13 pid: 5812 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708593.750390:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708593.750397:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427031c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:3286:x1876645426238464:12345-0@lo:103: 00010000:00010000:1.0:1789708593.750406:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708593.750411:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1400031600/0xa8f741d1c6865e8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865e88 expref: 13 pid: 5812 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.750420:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1400031600/0xa8f741d1c6865e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6865e88 expref: 13 pid: 5812 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.750431:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400031600/0xa8f741d1c6865e8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6865e88 expref: 13 pid: 5812 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.750443:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708593.750470:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427031c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:3286:x1876645426238464:12345-0@lo:103: Request processed in 74us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708593.750476:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708593.750503:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426238464:0@lo:103: 00000100:00100000:0.0:1789708593.750598:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789708593.750606:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+4:5812:x1876645426238208:12345-0@lo:104: 00010000:00010000:0.0:1789708593.750614:0:5802:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865e18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865e1f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.750832:0:5802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789708593.750838:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+4:5812:x1876645426238208:12345-0@lo:104: Request processed in 234us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708593.750844:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789708593.750858:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708593.750863:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:5812:x1876645426238336:12345-0@lo:104: 00010000:00010000:0.0:1789708593.750870:0:5802:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865e03 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.750924:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789708593.750929:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865e18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865e1f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.750936:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400030800 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:1.0:1789708593.750939:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865e18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6865e1f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.750945:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6865e1f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708593.750952:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6865e1f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708593.750957:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789708593.750979:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865e18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865e1f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.750986:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789708593.750996:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865e18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865e1f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.751002:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865e18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865e1f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.751023:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708593.751026:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865e03 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.751032:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400030000 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:1.0:1789708593.751040:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6865e03 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.751047:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6865e03 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708593.751053:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6865e03 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708593.751058:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789708593.751070:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865dfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865e03 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.751075:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789708593.751090:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865dfc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865e03 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.751096:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865dfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865e03 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.751109:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708593.751111:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708593.751113:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708593.751122:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426238592:0@lo:103: 00000100:00100000:1.0:1789708593.751148:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708593.751181:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426238592 00000100:00100000:1.0:1789708593.751185:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426238592 00010000:00010000:1.0:1789708593.751199:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a14013a0c00/0xa8f741d1c6865e1f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865e18 expref: 12 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708593.751216:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789708593.751229:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:3287:x1876645426238592:12345-0@lo:103: 00010000:00010000:1.0:1789708593.751236:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708593.751241:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a14013a0c00/0xa8f741d1c6865e1f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865e18 expref: 12 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.751250:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a14013a0c00/0xa8f741d1c6865e1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6865e18 expref: 12 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.751259:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708593.751285:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:3287:x1876645426238592:12345-0@lo:103: Request processed in 57us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708593.751291:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789708593.751316:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426238592:0@lo:103: 00010000:00010000:3.0:1789708593.751367:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a14013a0c00/0xa8f741d1c6865e1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6865e18 expref: 11 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708593.751377:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1876645426238208:0@lo:104: 00000100:00100000:3.0:1789708593.751393:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037ba680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5812:1876645426238336:0@lo:104: 00010000:00010000:3.0:1789708593.751410:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865eea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.751482:0:5802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1789708593.751489:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:5812:x1876645426238336:12345-0@lo:104: Request processed in 625us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708593.751494:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789708593.751534:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708593.753367:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426238720:0@lo:103: 00000100:00100000:2.0:1789708593.753420:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708593.753454:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426238720 00000100:00100000:1.0:1789708593.753462:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426238720 00010000:00010000:1.0:1789708593.753487:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a14013a1800/0xa8f741d1c6865e03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865dfc expref: 11 pid: 5812 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708593.753520:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789708593.753528:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a141080a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:3288:x1876645426238720:12345-0@lo:103: 00010000:00010000:1.0:1789708593.753540:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708593.753545:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a14013a1800/0xa8f741d1c6865e03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865dfc expref: 11 pid: 5812 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.753555:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a14013a1800/0xa8f741d1c6865e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6865dfc expref: 11 pid: 5812 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.753570:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a14013a1800/0xa8f741d1c6865e03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6865dfc expref: 11 pid: 5812 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.753596:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865eea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.753604:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865eea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.753621:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865eea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.753628:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865eea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.753635:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865eea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.753641:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865eea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.753672:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1401691a00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708593.753677:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865eea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.753686:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865eea lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.753700:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865eea lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.753710:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708593.753750:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a141080a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+10:3288:x1876645426238720:12345-0@lo:103: Request processed in 222us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708593.753765:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789708593.753783:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426238720:0@lo:103: 00010000:00010000:3.0:1789708593.753828:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865eea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.753837:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865eea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.753843:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865eea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789708593.753856:0:5812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789708593.786641:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+9:6668:x1876645426237952:12345-0@lo:253: Request processed in 42002us (42191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708593.786678:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789708593.786776:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426237952:0@lo:253: 10000000:01000000:3.0:1789708593.786790:0:6668:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789708593.786794:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789708593.786795:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789708593.786797:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708593.786798:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789708593.786811:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708593.786812:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708593.786814:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789708593.786815:0:6668:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789708593.786817:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708593.786818:0:6668:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789708593.786858:0:6668:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a143fa6b000 from lustre-OST0000 10000000:01000000:3.0:1789708593.786884:0:6668:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789708593.786886:0:6668:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789708593.786893:0:6668:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a1407ea19c0 local copy 10000000:01000000:3.0:1789708593.786897:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789708593.786933:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865ef1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.786944:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865ef1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.786954:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865ef1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708593.786971:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426238848:0@lo:101: 00000100:00100000:3.0:1789708593.787019:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708593.787120:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140ae81840 going to sleep for 11 seconds 00000100:00100000:1.0:1789708593.787240:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426238848 00000100:00100000:1.0:1789708593.787247:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426238848 00000100:00100000:1.0:1789708593.787322:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789708593.787331:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+9:6668:x1876645426238848:12345-0@lo:101: 00010000:00010000:1.0:1789708593.787343:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708593.787356:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a14013a1800/0xa8f741d1c6865ef8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865ef1 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.787377:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a14013a1800/0xa8f741d1c6865ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865ef1 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.787387:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a14013a1800/0xa8f741d1c6865ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865ef1 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.787395:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14013a1800, rc 0) 00000100:00100000:1.0:1789708593.787433:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+10:6668:x1876645426238848:12345-0@lo:101: Request processed in 103us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708593.787439:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789708593.787498:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426238848:0@lo:101: 00010000:00010000:3.0:1789708593.787509:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865ef1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa8f741d1c6865ef8 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.787518:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865ef1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa8f741d1c6865ef8 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708593.787607:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426238976:0@lo:501: 00000100:00100000:3.0:1789708593.787633:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708593.787763:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140ae81840 going to sleep for 11 seconds 00000100:00100000:0.0:1789708593.787836:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426238976 00000100:00100000:0.0:1789708593.787840:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426238976 00000100:00100000:0.0:1789708593.787862:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789708593.787867:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+10:6668:x1876645426238976:12345-0@lo:501: 00000100:00100000:0.0:1789708593.788068:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+10:6668:x1876645426238976:12345-0@lo:501: Request processed in 198us (433us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789708593.788085:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789708593.788155:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426238976:0@lo:501: 10000000:01000000:3.0:1789708593.788167:0:6668:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789708593.788192:0:6668:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789708593.788198:0:6668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865ef1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa8f741d1c6865ef8 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.788205:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865ef1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa8f741d1c6865ef8 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.788212:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865ef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa8f741d1c6865ef8 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.788234:0:6668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789708593.788252:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a143fa6b000 10000000:01000000:3.0:1789708593.788256:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789708593.788260:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8a1407ea19c0 10000000:01000000:3.0:1789708593.788262:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789708593.788266:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a1407ea19c0 from 1 10000000:01000000:3.0:1789708593.788269:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789708593.788284:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401691000/0xa8f741d1c6865eff lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.788291:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1401691000/0xa8f741d1c6865eff lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.788299:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1401691000/0xa8f741d1c6865eff lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708593.788309:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426239104:0@lo:101: 00000100:00100000:3.0:1789708593.788340:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708593.788352:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140ae81840 going to sleep for 11 seconds 00000100:00100000:1.0:1789708593.788388:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426239104 00000100:00100000:1.0:1789708593.788392:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426239104 00000100:00100000:1.0:1789708593.788410:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789708593.788416:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+10:6668:x1876645426239104:12345-0@lo:101: 00010000:00010000:1.0:1789708593.788423:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708593.788433:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a14013a0a00/0xa8f741d1c6865f06 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865eff expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.788453:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a14013a0a00/0xa8f741d1c6865f06 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865eff expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.788462:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a14013a0a00/0xa8f741d1c6865f06 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865eff expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.788469:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14013a0a00, rc 0) 00000100:00100000:1.0:1789708593.788504:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:6668:x1876645426239104:12345-0@lo:101: Request processed in 88us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708593.788510:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789708593.788583:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426239104:0@lo:101: 00010000:00010000:3.0:1789708593.788593:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1401691000/0xa8f741d1c6865eff lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f06 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.788600:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1401691000/0xa8f741d1c6865eff lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865f06 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708593.788613:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789708593.788630:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401691000/0xa8f741d1c6865eff lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f06 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.788637:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1401691000/0xa8f741d1c6865eff lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f06 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708593.788642:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789708593.788646:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789708593.788670:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789708593.788671:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789708593.788685:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6865f0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.788692:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6865f0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.788700:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6865f0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708593.788711:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426239232:0@lo:101: 00000100:00100000:3.0:1789708593.788743:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708593.788761:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140ae81840 going to sleep for 11 seconds 00000100:00100000:1.0:1789708593.788824:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426239232 00000100:00100000:1.0:1789708593.788828:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426239232 00000100:00100000:1.0:1789708593.788846:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789708593.788852:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:6668:x1876645426239232:12345-0@lo:101: 00010000:00010000:1.0:1789708593.788859:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708593.788865:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a14013a1c00/0xa8f741d1c6865f14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865f0d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.788878:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a14013a1c00/0xa8f741d1c6865f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865f0d expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.788885:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a14013a1c00/0xa8f741d1c6865f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865f0d expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708593.788891:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14013a1c00, rc 0) 00000100:00100000:1.0:1789708593.788927:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:6668:x1876645426239232:12345-0@lo:101: Request processed in 75us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708593.788933:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789708593.789020:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426239232:0@lo:101: 00010000:00010000:3.0:1789708593.789029:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6865f0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f14 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.789036:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6865f0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865f14 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708593.789092:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426239360:0@lo:501: 00000100:00100000:3.0:1789708593.789117:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708593.789139:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140ae81840 going to sleep for 11 seconds 00010000:00010000:0.0:1789708593.789198:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708593.789205:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865ef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa8f741d1c6865ef8 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.789212:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1401691a00 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:0.0:1789708593.789216:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865ef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa8f741d1c6865ef8 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.789224:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865ef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa8f741d1c6865ef8 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708593.789231:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865ef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa8f741d1c6865ef8 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708593.789236:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789708593.789254:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865ef1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa8f741d1c6865ef8 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.789260:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708593.789289:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865ef1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa8f741d1c6865ef8 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.789295:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865ef1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa8f741d1c6865ef8 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.789309:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708593.789311:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708593.789312:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708593.789320:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708593.789335:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426239488:0@lo:103: 00000100:00100000:0.0:1789708593.789361:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708593.789390:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426239488 00000100:00100000:0.0:1789708593.789394:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426239488 00000100:00100000:0.0:1789708593.789420:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708593.789427:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e162680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:3288:x1876645426239488:12345-0@lo:103: 00010000:00010000:0.0:1789708593.789437:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708593.789448:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a14013a1800/0xa8f741d1c6865ef8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa8f741d1c6865ef1 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.789457:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708593.789483:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e162680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:3288:x1876645426239488:12345-0@lo:103: Request processed in 57us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708593.789490:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708593.789514:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426239488:0@lo:103: 00000100:00100000:0.0:1789708593.789531:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426239360 00000100:00100000:0.0:1789708593.789535:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426239360 00000100:00100000:0.0:1789708593.789550:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789708593.789556:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:6668:x1876645426239360:12345-0@lo:501: 00000100:00100000:0.0:1789708593.789750:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:6668:x1876645426239360:12345-0@lo:501: Request processed in 193us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708593.789757:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789708593.789880:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426239360:0@lo:501: 00000100:00100000:3.0:1789708593.789922:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426239616:0@lo:503: 00000100:00100000:3.0:1789708593.789961:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708593.789988:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140ae81840 going to sleep for 11 seconds 00000100:00100000:0.0:1789708593.790042:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426239616 00000100:00100000:0.0:1789708593.790046:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426239616 00000100:00100000:0.0:1789708593.790075:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789708593.790081:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:6668:x1876645426239616:12345-0@lo:503: 00000100:00100000:0.0:1789708593.790265:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:6668:x1876645426239616:12345-0@lo:503: Request processed in 183us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708593.790276:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789708593.790413:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426239616:0@lo:503: 00000040:00080000:3.0:1789708593.790788:0:6668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789708593.790848:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426239744:0@lo:502: 00000100:00100000:3.0:1789708593.790882:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708593.790940:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140ae81840 going to sleep for 11 seconds 00000100:00100000:0.0:1789708593.790978:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426239744 00000100:00100000:0.0:1789708593.790983:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426239744 00000100:00100000:0.0:1789708593.791053:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789708593.791060:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:6668:x1876645426239744:12345-0@lo:502: 00000100:00100000:0.0:1789708593.791240:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:6668:x1876645426239744:12345-0@lo:502: Request processed in 181us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708593.791247:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789708593.791404:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426239744:0@lo:502: 00000040:00080000:3.0:1789708593.791638:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789708593.791708:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789708593.791744:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789708593.791807:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789708593.791852:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789708593.791886:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789708593.791911:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426239872:0@lo:502: 00000100:00100000:3.0:1789708593.791949:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708593.792040:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140ae81840 going to sleep for 11 seconds 00000100:00100000:0.0:1789708593.792100:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426239872 00000100:00100000:0.0:1789708593.792105:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426239872 00000100:00100000:0.0:1789708593.792137:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789708593.792144:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:6668:x1876645426239872:12345-0@lo:502: 00000100:00100000:0.0:1789708593.792294:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:6668:x1876645426239872:12345-0@lo:502: Request processed in 150us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708593.792302:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789708593.792424:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426239872:0@lo:502: 00000040:00080000:3.0:1789708593.792524:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789708593.792533:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1789708593.793082:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789708593.793091:0:6688:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789708593.793099:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708593.793102:0:6688:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789708593.793107:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789708593.793120:0:6688:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a1407ea4d40) 00000020:00000080:1.0:1789708593.793140:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789708593.793147:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789708593.793220:0:6688:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a143fa6b000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789708593.793228:0:6688:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789708593.793236:0:6688:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa8f741d1c6865f22 00010000:00010000:1.0:1789708593.797813:0:6688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1789708593.798162:0:6688:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789708593.800832:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789708593.801100:0:6688:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789708593.807370:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789708593.808120:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789708593.809375:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789708593.809388:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708593.809395:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708593.809397:0:6688:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789708593.809401:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708593.809405:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708593.809406:0:6688:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789708593.809409:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789708593.809411:0:6688:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789708593.809458:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708593.809462:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708593.809463:0:6688:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789708593.809479:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789708593.809694:0:6668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789708593.809735:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789708593.809755:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6865f0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f14 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.809768:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6865f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f14 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708593.809776:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a143fa6b000 from 1 10000000:01000000:3.0:1789708593.809779:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708593.809812:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401690000/0xa8f741d1c6865f29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.809820:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1401690000/0xa8f741d1c6865f29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.809830:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1401690000/0xa8f741d1c6865f29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708593.809853:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426240000:0@lo:101: 00000100:00100000:3.0:1789708593.809918:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708593.809984:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140ae81840 going to sleep for 11 seconds 00000100:00100000:2.0:1789708593.810078:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426240000 00000100:00100000:2.0:1789708593.810086:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426240000 00000100:00100000:2.0:1789708593.810130:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789708593.810140:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:6668:x1876645426240000:12345-0@lo:101: 00010000:00010000:2.0:1789708593.810154:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708593.810165:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1403b6a000/0xa8f741d1c6865f30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865f29 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.810186:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1403b6a000/0xa8f741d1c6865f30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865f29 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.810197:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1403b6a000/0xa8f741d1c6865f30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865f29 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.810205:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6a000, rc 0) 00000100:00100000:2.0:1789708593.810245:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:6668:x1876645426240000:12345-0@lo:101: Request processed in 107us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708593.810258:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789708593.810303:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426240000:0@lo:101: 00010000:00010000:2.0:1789708593.810315:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1401690000/0xa8f741d1c6865f29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f30 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708593.810323:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1401690000/0xa8f741d1c6865f29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865f30 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708593.810401:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426240128:0@lo:501: 00000100:00100000:2.0:1789708593.810428:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708593.810443:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1306c82180 going to sleep for 11 seconds 00000100:00100000:2.0:1789708593.810458:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426240128 00000100:00100000:2.0:1789708593.810462:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426240128 00000100:00100000:2.0:1789708593.810500:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789708593.810507:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:6668:x1876645426240128:12345-0@lo:501: 00000100:00100000:2.0:1789708593.810741:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:6668:x1876645426240128:12345-0@lo:501: Request processed in 234us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708593.810748:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789708593.810791:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426240128:0@lo:501: 00000100:00100000:2.0:1789708593.810827:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426240256:0@lo:503: 00000100:00100000:2.0:1789708593.810866:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708593.810879:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1306c82180 going to sleep for 11 seconds 00000100:00100000:2.0:1789708593.810892:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426240256 00000100:00100000:2.0:1789708593.810895:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426240256 00000100:00100000:2.0:1789708593.810912:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789708593.810918:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:6668:x1876645426240256:12345-0@lo:503: 00000100:00100000:2.0:1789708593.811083:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:6668:x1876645426240256:12345-0@lo:503: Request processed in 164us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708593.811090:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789708593.811130:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426240256:0@lo:503: 00000040:00080000:2.0:1789708593.811366:0:6668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789708593.811420:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426240384:0@lo:502: 00000100:00100000:2.0:1789708593.811452:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708593.811465:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1306c82180 going to sleep for 11 seconds 00000100:00100000:2.0:1789708593.811478:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426240384 00000100:00100000:2.0:1789708593.811482:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426240384 00000100:00100000:2.0:1789708593.811498:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789708593.811503:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:6668:x1876645426240384:12345-0@lo:502: 00000100:00100000:2.0:1789708593.811630:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:6668:x1876645426240384:12345-0@lo:502: Request processed in 126us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708593.811637:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789708593.811694:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426240384:0@lo:502: 00000040:00080000:2.0:1789708593.811904:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789708593.811943:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789708593.811963:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426240512:0@lo:502: 00000100:00100000:2.0:1789708593.811994:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708593.812029:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426240512 00000100:00100000:2.0:1789708593.812033:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426240512 00000100:00100000:2.0:1789708593.812049:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789708593.812054:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:6668:x1876645426240512:12345-0@lo:502: 00000100:00100000:2.0:1789708593.812161:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:6668:x1876645426240512:12345-0@lo:502: Request processed in 106us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708593.812176:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789708593.812202:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1306c82180 going to sleep for 11 seconds 00000100:00100000:2.0:1789708593.812214:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426240512:0@lo:502: 00000040:00080000:2.0:1789708593.812296:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789708593.812305:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789708593.818871:0:6691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708593.818884:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708593.818886:0:6691:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789708593.818899:0:6691:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a143fa6b000 00000020:00000080:1.0:1789708593.818902:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789708593.818926:0:6691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708593.818928:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708593.818930:0:6691:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789708593.818933:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789708593.820594:0:6668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789708593.820638:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708593.820819:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401690000/0xa8f741d1c6865f29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f30 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.820833:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1401690000/0xa8f741d1c6865f29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f30 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708593.820880:0:6668:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789708593.820883:0:6668:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a143fa6b000 10000000:01000000:3.0:1789708593.820887:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a143fa6b000 10000000:01000000:3.0:1789708593.820892:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789708593.820898:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a143fa6b000 from 1 10000000:01000000:3.0:1789708593.820900:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789708593.820936:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401691200/0xa8f741d1c6865f37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.820945:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1401691200/0xa8f741d1c6865f37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.820955:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1401691200/0xa8f741d1c6865f37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708593.820979:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426240640:0@lo:101: 00000100:00100000:3.0:1789708593.821060:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708593.821105:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140ae81f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708593.821706:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426240640 00000100:00100000:0.0:1789708593.821714:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426240640 00000100:00100000:0.0:1789708593.821763:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789708593.821771:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:6668:x1876645426240640:12345-0@lo:101: 00010000:00010000:0.0:1789708593.821784:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708593.821796:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400030a00/0xa8f741d1c6865f3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865f37 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.821816:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400030a00/0xa8f741d1c6865f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865f37 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.821826:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400030a00/0xa8f741d1c6865f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865f37 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.821842:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400030a00, rc 0) 00000100:00100000:0.0:1789708593.821887:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:6668:x1876645426240640:12345-0@lo:101: Request processed in 117us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708593.821894:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789708593.821941:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426240640:0@lo:101: 00010000:00010000:0.0:1789708593.821955:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1401691200/0xa8f741d1c6865f37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f3e expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.821963:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1401691200/0xa8f741d1c6865f37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865f3e expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708593.822080:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e160e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426240768:0@lo:501: 00000100:00100000:0.0:1789708593.822110:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708593.822132:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405008900 going to sleep for 11 seconds 00000100:00100000:1.0:1789708593.822197:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426240768 00000100:00100000:1.0:1789708593.822202:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426240768 00000100:00100000:1.0:1789708593.822520:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789708593.822528:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:6668:x1876645426240768:12345-0@lo:501: 00000100:00100000:1.0:1789708593.822767:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:6668:x1876645426240768:12345-0@lo:501: Request processed in 239us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708593.822775:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789708593.823107:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e160e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426240768:0@lo:501: 00000100:00100000:1.0:1789708593.823151:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427033100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426240896:0@lo:503: 00000100:00100000:1.0:1789708593.823196:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708593.823259:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1404e83d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708593.823294:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426240896 00000100:00100000:0.0:1789708593.823300:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426240896 00000100:00100000:0.0:1789708593.823363:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789708593.823371:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:6668:x1876645426240896:12345-0@lo:503: 00000100:00100000:0.0:1789708593.823552:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:6668:x1876645426240896:12345-0@lo:503: Request processed in 181us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708593.823559:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789708593.823619:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427033100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426240896:0@lo:503: 00000040:00080000:1.0:1789708593.823918:0:6668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789708593.823975:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427033100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426241024:0@lo:502: 00000100:00100000:1.0:1789708593.824023:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708593.824274:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1404e83d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708593.824358:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426241024 00000100:00100000:3.0:1789708593.824363:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426241024 00000100:00100000:3.0:1789708593.824387:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789708593.824394:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:6668:x1876645426241024:12345-0@lo:502: 00000100:00100000:3.0:1789708593.824581:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:6668:x1876645426241024:12345-0@lo:502: Request processed in 188us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708593.824588:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789708593.824726:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427033100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426241024:0@lo:502: 00000040:00080000:1.0:1789708593.824936:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789708593.824977:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789708593.825016:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789708593.825065:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789708593.825114:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789708593.825160:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789708593.825198:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789708593.825226:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789708593.825272:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789708593.825303:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789708593.825329:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789708593.825365:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789708593.825393:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789708593.825419:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789708593.825454:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789708593.825586:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789708593.825629:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789708593.825783:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789708593.825818:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789708593.825845:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789708593.825882:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789708593.825909:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789708593.825935:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789708593.825983:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789708593.826028:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789708593.826059:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789708593.826098:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789708593.826126:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1789708593.826156:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427033100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426241152:0@lo:502: 00000100:00100000:1.0:1789708593.826202:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708593.826262:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1404e83d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708593.826294:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426241152 00000100:00100000:3.0:1789708593.826300:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426241152 00000100:00100000:3.0:1789708593.826330:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789708593.826336:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:6668:x1876645426241152:12345-0@lo:502: 00000100:00100000:3.0:1789708593.826596:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:6668:x1876645426241152:12345-0@lo:502: Request processed in 259us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708593.826604:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789708593.826715:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427033100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426241152:0@lo:502: 00000040:00080000:1.0:1789708593.826792:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789708593.826802:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1789708593.827359:0:6693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789708593.827375:0:6693:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a1407ea0000) 00000020:00000080:1.0:1789708593.827393:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1789708593.827456:0:6693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a143fa6b000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789708593.827460:0:6693:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a143fa6b000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789708593.827462:0:6693:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a143fa6b000 3 00010000:00080000:1.0:1789708593.827547:0:6693:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1410961800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.153@tcp at head 00010000:00010000:1.0:1789708593.829252:0:6693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1789708593.829506:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789708593.829548:0:6693:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789708593.829560:0:6693:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa8f741d1c6865f4c 00000100:00080000:1.0:1789708593.829568:0:6693:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789708593.829578:0:6693:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a1410961800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1789708593.829611:0:6693:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1427033100 x1876645426241280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789708593.829645:0:6693:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789708593.829755:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789708593.829769:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876645426241408:0@lo:400: 00000100:00100000:1.0:1789708593.829826:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708593.829880:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426241408 00000100:00100000:1.0:1789708593.829887:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426241408 00000100:00100000:1.0:1789708593.829925:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789708593.829934:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876645426241408:12345-0@lo:400: 00000100:00100000:1.0:1789708593.829981:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876645426241408:12345-0@lo:400: Request processed in 48us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708593.829989:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789708593.830039:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a1427030a80 x1876645426241408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708593.830052:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876645426241408:0@lo:400: 00000100:00100000:2.0:1789708593.830286:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1876645426241280:0@lo:38: 00000100:00100000:2.0:1789708593.830328:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708593.830420:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426241280 00000100:00100000:1.0:1789708593.830425:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426241280 00000100:00100000:1.0:1789708593.830458:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708593.830518:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a141080b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1876645426241280:12345-0@lo:38: 00010000:00080000:1.0:1789708593.830539:0:5821:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:1.0:1789708593.830577:0:5821:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa8f741d1c6865f53 00000004:00100000:1.0:1789708593.830590:0:5821:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789708593.830619:0:5821:0:(import.c:65:import_set_state_nolock()) ffff8a1406a52000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708593.830871:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a141080b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876645426241280:12345-0@lo:38: Request processed in 353us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708593.830878:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:1.0:1789708593.831016:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:2.0:1789708593.831181:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a1427033100 x1876645426241280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708593.831190:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789708593.831196:0:3285:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789708593.831202:0:3285:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789708593.831206:0:3285:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789708593.831209:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a1410961800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789708593.831214:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1876645426241280:0@lo:38: 00000020:01000000:0.0:1789708593.831346:0:6668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789708593.831383:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789708593.831434:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401691200/0xa8f741d1c6865f37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f3e expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.831455:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1401691200/0xa8f741d1c6865f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f3e expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789708593.831512:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789708593.831515:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789708593.831516:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708593.831517:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708593.831518:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708593.831519:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708593.831520:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789708593.831522:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789708593.831523:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789708593.831525:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708593.831526:0:6668:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789708593.831529:0:6668:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789708593.831532:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789708593.831533:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789708593.831534:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708593.831535:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708593.831536:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708593.831537:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708593.831538:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789708593.831539:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789708593.831540:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789708593.831541:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708593.831542:0:6668:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789708593.831565:0:6668:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789708593.831577:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e160a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426241536:0@lo:253: 00000100:00100000:0.0:1789708593.831621:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708593.831676:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405008900 going to sleep for 11 seconds 00000100:00100000:1.0:1789708593.831806:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426241536 00000100:00100000:1.0:1789708593.831812:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426241536 00000100:00100000:1.0:1789708593.831849:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789708593.831857:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:6668:x1876645426241536:12345-0@lo:253: 20000000:01000000:1.0:1789708593.831879:0:5812:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789708593.831891:0:5812:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789708593.856704:0:5812:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789708593.856715:0:5812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789708593.856845:0:5835:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789708593.856850:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789708593.856870:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865f5a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.856915:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6865ec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865eb9 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.856924:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865f5a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.856961:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6865ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6865eb9 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.856974:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6865ec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6865eb9 expref: 13 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708593.856988:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5835:1876645426241664:0@lo:104: 00000100:00100000:0.0:1789708593.857716:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708593.858250:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426241664 00000100:00100000:3.0:1789708593.858260:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426241664 00000100:00100000:0.0:1789708593.858281:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1302c29180 going to sleep for 11 seconds 00000100:00100000:3.0:1789708593.858319:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789708593.858329:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e160700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:5835:x1876645426241664:12345-0@lo:104: 00010000:00010000:3.0:1789708593.858344:0:5802:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865ec0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.858401:0:5802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789708593.858407:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e160700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:5835:x1876645426241664:12345-0@lo:104: Request processed in 81us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708593.858414:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789708593.858434:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708593.858440:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865ec0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.858448:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400031000 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:3.0:1789708593.858453:0:5807:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6865ec0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.858473:0:5807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865eb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6865ec0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708593.858480:0:5807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865eb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6865ec0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708593.858486:0:5807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789708593.858516:0:5807:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865eb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865ec0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.858522:0:5807:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708593.858539:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865eb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865ec0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.858546:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865eb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865ec0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.858562:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708593.858564:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708593.858565:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708593.858576:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426241792:0@lo:103: 00000100:00100000:3.0:1789708593.858606:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708593.858640:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426241792 00000100:00100000:3.0:1789708593.858644:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426241792 00010000:00010000:3.0:1789708593.858689:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6865ec0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865eb9 expref: 14 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708593.858709:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789708593.858715:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1408282050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:3287:x1876645426241792:12345-0@lo:103: 00010000:00010000:3.0:1789708593.858730:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708593.858735:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6865ec0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865eb9 expref: 14 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.858744:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6865ec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6865eb9 expref: 14 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.858759:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865f5a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.858768:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865f5a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789708593.858781:0:5804:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001931724s 00010000:00010000:3.0:1789708593.858785:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865f5a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.858792:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865f5a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.858911:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865f5a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.858920:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865f5a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.858927:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400030c00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708593.858931:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865f5a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.858939:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865f5a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.858953:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865f5a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708593.858965:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708593.858995:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1408282050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:3287:x1876645426241792:12345-0@lo:103: Request processed in 280us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708593.859042:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789708593.859115:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6865ec0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6865eb9 expref: 13 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708593.859128:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5835:1876645426241664:0@lo:104: 00000100:00100000:3.0:1789708593.859131:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426241792:0@lo:103: 00010000:00010000:0.0:1789708593.859150:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865f5a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.859160:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865f5a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.859166:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865f5a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708593.859172:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865f5a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708593.864850:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:6668:x1876645426241536:12345-0@lo:253: Request processed in 32986us (33220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708593.864866:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789708593.864877:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e160a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:6668:1876645426241536:0@lo:253: 10000000:01000000:0.0:1789708593.864896:0:6668:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789708593.864900:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789708593.864902:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789708593.864904:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708593.864906:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708593.864907:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708593.864909:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708593.864910:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789708593.864912:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789708593.864913:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789708593.864915:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708593.864916:0:6668:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789708593.864953:0:6668:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789708593.869126:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789708593.869305:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789708593.869573:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789708593.869781:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789708593.869978:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789708593.870207:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789708593.872546:0:6668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789708594.003964:0:6668:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789708594.003971:0:6668:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789708594.004011:0:6668:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789708594.004066:0:6668:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789708594.004084:0:6668:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789708594.004110:0:6668:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789708594.299859:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708595.323610:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708596.347036:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708597.372385:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789708597.382847:0:7036:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789708598.396892:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708599.035300:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426242176:0@lo:400: 00000100:00100000:0.0:1789708599.035300:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876645426242048:0@lo:400: 00000100:00100000:1.0:1789708599.035380:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426241920:0@lo:400: 00000100:00100000:1.0:1789708599.036444:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708599.036445:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708599.036504:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708599.036554:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426242048 00000100:00100000:1.0:1789708599.036568:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426242048 00000100:00100000:1.0:1789708599.036629:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426242176 00000100:00100000:1.0:1789708599.036633:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426242176 00000100:00100000:0.0:1789708599.036637:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708599.036671:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876645426242048:12345-0@lo:400: 00000100:00100000:1.0:1789708599.036689:0:5819:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789708599.036698:0:5819:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789708599.036716:0:5821:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789708599.036733:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876645426242048:12345-0@lo:400: Request processed in 86us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708599.036739:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789708599.036746:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708599.036751:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426242176:12345-0@lo:400: 00010000:00080000:0.0:1789708599.036792:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a14037b9180 x1876645426242048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708599.036808:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426242176:12345-0@lo:400: Request processed in 60us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708599.036809:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876645426242048:0@lo:400: 00000100:00100000:1.0:1789708599.036823:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789708599.036842:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a14037bbb80 x1876645426242176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789708599.036849:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708599.036858:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426242176:0@lo:400: 00000100:00100000:2.0:1789708599.037795:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426241920 00000100:00100000:2.0:1789708599.037802:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426241920 00000100:00100000:2.0:1789708599.037842:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789708599.037852:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:3288:x1876645426241920:12345-0@lo:400: 00000100:00100000:2.0:1789708599.037907:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:3288:x1876645426241920:12345-0@lo:400: Request processed in 57us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708599.037914:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789708599.037919:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426241920:0@lo:400: 00010000:00010000:0.0:1789708599.420158:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789708599.546823:0:5816:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789708599.546831:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1410604800 from 21 10000000:01000000:2.0:1789708599.546851:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789708599.546895:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1403b6aa00/0xa8f741d1c6865f61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708599.546906:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1403b6aa00/0xa8f741d1c6865f61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708599.546917:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1403b6aa00/0xa8f741d1c6865f61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708599.546939:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1410809f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426242304:0@lo:101: 00000100:00100000:2.0:1789708599.547068:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708599.547123:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140ae81a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708599.547144:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426242304 00000100:00100000:1.0:1789708599.547153:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426242304 00000100:00100000:1.0:1789708599.547206:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789708599.547215:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:5816:x1876645426242304:12345-0@lo:101: 00010000:00010000:1.0:1789708599.547228:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708599.547241:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a14013a0600/0xa8f741d1c6865f68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865f61 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708599.547265:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a14013a0600/0xa8f741d1c6865f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865f61 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708599.547276:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a14013a0600/0xa8f741d1c6865f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865f61 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708599.547286:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14013a0600, rc 0) 00000100:00100000:1.0:1789708599.547329:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:5816:x1876645426242304:12345-0@lo:101: Request processed in 115us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708599.547338:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789708599.547364:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1410809f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426242304:0@lo:101: 00010000:00010000:2.0:1789708599.547386:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1403b6aa00/0xa8f741d1c6865f61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f68 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708599.547396:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1403b6aa00/0xa8f741d1c6865f61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865f68 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708599.547446:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1410809f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426242432:0@lo:501: 00000100:00100000:2.0:1789708599.547470:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708599.547495:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140ae81a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708599.547694:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426242432 00000100:00100000:0.0:1789708599.547699:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426242432 00000100:00100000:0.0:1789708599.547726:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789708599.547733:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:5816:x1876645426242432:12345-0@lo:501: 00000100:00100000:0.0:1789708599.547980:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:5816:x1876645426242432:12345-0@lo:501: Request processed in 245us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708599.547988:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789708599.548056:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1410809f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426242432:0@lo:501: 00000100:00100000:2.0:1789708599.548095:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1410809f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426242560:0@lo:503: 00000100:00100000:2.0:1789708599.548136:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708599.548163:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140ae81a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708599.548215:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426242560 00000100:00100000:1.0:1789708599.548225:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426242560 00000100:00100000:1.0:1789708599.548255:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789708599.548261:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:5816:x1876645426242560:12345-0@lo:503: 00000100:00100000:1.0:1789708599.548441:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:5816:x1876645426242560:12345-0@lo:503: Request processed in 180us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708599.548448:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789708599.548700:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1410809f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426242560:0@lo:503: 00000100:00100000:2.0:1789708599.549857:0:7160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1410808380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7160:1876645426242688:0@lo:502: 00000100:00100000:2.0:1789708599.549908:0:7160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708599.549990:0:7160:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140800a240 going to sleep for 11 seconds 00000100:00100000:0.0:1789708599.550028:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426242688 00000100:00100000:0.0:1789708599.550034:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426242688 00000100:00100000:0.0:1789708599.550073:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789708599.550079:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:7160:x1876645426242688:12345-0@lo:502: 00000100:00100000:0.0:1789708599.550342:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:7160:x1876645426242688:12345-0@lo:502: Request processed in 262us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708599.550350:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789708599.550413:0:7160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1410808380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7160:1876645426242688:0@lo:502: 00000100:00100000:2.0:1789708599.550454:0:7160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1410808380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7160:1876645426242816:0@lo:502: 00000100:00100000:2.0:1789708599.550487:0:7160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708599.550510:0:7160:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1410bfb600 going to sleep for 11 seconds 00000100:00100000:1.0:1789708599.550639:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426242816 00000100:00100000:1.0:1789708599.550644:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426242816 00000100:00100000:1.0:1789708599.550693:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789708599.550700:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:7160:x1876645426242816:12345-0@lo:502: 00000100:00100000:1.0:1789708599.550850:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:7160:x1876645426242816:12345-0@lo:502: Request processed in 150us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708599.550857:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789708599.550874:0:7160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1410808380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7160:1876645426242816:0@lo:502: 00000040:00080000:2.0:1789708599.550898:0:7160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789708599.551055:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789708599.551079:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789708599.551088:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1403b6aa00/0xa8f741d1c6865f61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f68 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708599.551099:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1403b6aa00/0xa8f741d1c6865f61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f68 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708599.551108:0:5816:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789708599.551111:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1410604800 from 4 10000000:01000000:0.0:1789708599.551113:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789708599.551137:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708599.551145:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708599.551154:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708599.551166:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426242944:0@lo:101: 00000100:00100000:0.0:1789708599.551193:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708599.551254:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405876e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708599.551286:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426242944 00000100:00100000:2.0:1789708599.551290:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426242944 00000100:00100000:2.0:1789708599.551317:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789708599.551324:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:5816:x1876645426242944:12345-0@lo:101: 00010000:00010000:2.0:1789708599.551333:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708599.551348:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1403b6a800/0xa8f741d1c6865f76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865f6f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708599.551366:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1403b6a800/0xa8f741d1c6865f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865f6f expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708599.551376:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1403b6a800/0xa8f741d1c6865f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865f6f expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708599.551385:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6a800, rc 0) 00000100:00100000:2.0:1789708599.551455:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:5816:x1876645426242944:12345-0@lo:101: Request processed in 131us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708599.551462:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789708599.551509:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426242944:0@lo:101: 00010000:00010000:0.0:1789708599.551520:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865f6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f76 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708599.551528:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865f6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865f76 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708599.551579:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426243072:0@lo:256: 00000100:00100000:0.0:1789708599.551607:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708599.551624:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405876e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708599.551674:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426243072 00000100:00100000:1.0:1789708599.551680:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426243072 00000100:00100000:1.0:1789708599.551708:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789708599.551716:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:5816:x1876645426243072:12345-0@lo:256: 20000000:01000000:1.0:1789708599.551730:0:5813:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789708599.551748:0:5813:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789708599.551752:0:5813:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789708599.551846:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:5816:x1876645426243072:12345-0@lo:256: Request processed in 130us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708599.551854:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789708599.551858:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426243072:0@lo:256: 10000000:01000000:0.0:1789708599.551897:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789708599.551903:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865f6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f76 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708599.551909:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f76 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708599.551916:0:5816:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789708599.551918:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789708599.551921:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789708599.551935:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865f7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708599.551942:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865f7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708599.551959:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865f7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708599.551971:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426243200:0@lo:101: 00000100:00100000:0.0:1789708599.551995:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708599.552056:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405876e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708599.552084:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426243200 00000100:00100000:2.0:1789708599.552093:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426243200 00000100:00100000:2.0:1789708599.552150:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789708599.552157:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:5816:x1876645426243200:12345-0@lo:101: 00010000:00010000:2.0:1789708599.552163:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708599.552172:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1403b6b600/0xa8f741d1c6865f84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865f7d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708599.552185:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1403b6b600/0xa8f741d1c6865f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865f7d expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708599.552192:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1403b6b600/0xa8f741d1c6865f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865f7d expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708599.552199:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6b600, rc 0) 00000100:00100000:2.0:1789708599.552231:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:5816:x1876645426243200:12345-0@lo:101: Request processed in 74us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708599.552236:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789708599.552285:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426243200:0@lo:101: 00010000:00010000:0.0:1789708599.552300:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865f7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f84 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708599.552307:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865f7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865f84 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708599.552342:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426243328:0@lo:501: 00000100:00100000:0.0:1789708599.552363:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708599.552424:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405876e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708599.552447:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426243328 00000100:00100000:3.0:1789708599.552451:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426243328 00000100:00100000:3.0:1789708599.552471:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789708599.552476:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:5816:x1876645426243328:12345-0@lo:501: 00000100:00100000:3.0:1789708599.552771:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:5816:x1876645426243328:12345-0@lo:501: Request processed in 293us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708599.552778:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789708599.552831:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426243328:0@lo:501: 00000100:00100000:0.0:1789708599.552862:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426243456:0@lo:503: 00000100:00100000:0.0:1789708599.552896:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708599.552917:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405876e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708599.552963:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426243456 00000100:00100000:1.0:1789708599.552968:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426243456 00000100:00100000:1.0:1789708599.552992:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789708599.553000:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:5816:x1876645426243456:12345-0@lo:503: 00000100:00100000:1.0:1789708599.553575:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:5816:x1876645426243456:12345-0@lo:503: Request processed in 576us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708599.553587:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789708599.553607:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426243456:0@lo:503: 00000100:00100000:3.0:1789708599.553927:0:7161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7161:1876645426243584:0@lo:502: 00000100:00100000:3.0:1789708599.553975:0:7161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708599.554003:0:7161:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308543f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708599.554051:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426243584 00000100:00100000:2.0:1789708599.554056:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426243584 00000100:00100000:2.0:1789708599.554083:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789708599.554090:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:7161:x1876645426243584:12345-0@lo:502: 00000100:00100000:2.0:1789708599.554290:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:7161:x1876645426243584:12345-0@lo:502: Request processed in 201us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708599.554297:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789708599.554407:0:7161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7161:1876645426243584:0@lo:502: 00000020:01000000:1.0:1789708599.554430:0:7161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789708599.554436:0:7161:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789708599.554443:0:7161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708599.554446:0:7161:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789708599.554451:0:7161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789708599.554455:0:7161:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:01000000:1.0:1789708599.554475:0:7161:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789708599.554478:0:7161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789708599.554497:0:7161:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a1407703380) 00000020:00000080:1.0:1789708599.554516:0:7161:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789708599.554522:0:7161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789708599.554584:0:7161:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789708599.554589:0:7161:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789708599.554596:0:7161:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa8f741d1c6865f92 00010000:00080000:1.0:1789708599.554621:0:7161:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1410964800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:1.0:1789708599.554945:0:7161:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789708599.580028:0:7161:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789708599.580052:0:7161:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789708599.580503:0:7161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708599.580680:0:7161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708599.580720:0:7161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789708599.580758:0:7161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789708599.581081:0:7163:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789708599.581086:0:7163:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789708599.581772:0:7161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789708599.581787:0:7161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789708599.581821:0:7161:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789708599.581851:0:7161:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa8f741d1c6865f99 00000100:00080000:1.0:1789708599.581862:0:7161:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789708599.581874:0:7161:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a1410964800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1789708599.581907:0:7161:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1427030a80 x1876645426243712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789708599.581933:0:7161:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789708599.582004:0:7161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708599.582008:0:7161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708599.582010:0:7161:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789708599.582013:0:7161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708599.582017:0:7161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708599.582019:0:7161:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789708599.582022:0:7161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789708599.582024:0:7161:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789708599.582050:0:7161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427030700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7161:1876645426243840:0@lo:502: 00000100:00100000:1.0:1789708599.582128:0:7161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708599.582163:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426243840 00000100:00100000:1.0:1789708599.582169:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426243840 00000100:00100000:1.0:1789708599.582203:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789708599.582212:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:7161:x1876645426243840:12345-0@lo:502: 00000100:00100000:1.0:1789708599.582411:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:7161:x1876645426243840:12345-0@lo:502: Request processed in 199us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708599.582419:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789708599.582475:0:7161:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14051bb540 going to sleep for 11 seconds 00000100:00100000:1.0:1789708599.582496:0:7161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427030700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7161:1876645426243840:0@lo:502: 00000020:01000000:1.0:1789708599.582519:0:7161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708599.582523:0:7161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708599.582525:0:7161:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789708599.582528:0:7161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:2.0:1789708599.582692:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426243712:0@lo:8: 00000100:00100000:2.0:1789708599.582729:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1789708599.582880:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789708599.582907:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789708599.582917:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865f7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f84 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708599.582928:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865f7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865f84 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708599.582938:0:5816:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789708599.582941:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a1407ea19c0 from 1 10000000:01000000:0.0:1789708599.582944:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789708599.582976:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708599.582994:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708599.583005:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708599.583018:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e163800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426244224:0@lo:101: 00000100:00100000:0.0:1789708599.583048:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708599.583065:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405876f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708599.583079:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789708599.583087:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426243968:0@lo:400: 00000100:00100000:0.0:1789708599.583113:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708599.583140:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426244096:0@lo:400: 00000100:00100000:0.0:1789708599.583175:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708599.583211:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426244224 00000100:00100000:0.0:1789708599.583216:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426244224 00000100:00100000:0.0:1789708599.583241:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789708599.583248:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:5816:x1876645426244224:12345-0@lo:101: 00010000:00010000:0.0:1789708599.583258:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708599.583269:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865fa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865fa0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708599.583289:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865fa0 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708599.583299:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865fa0 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708599.583319:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400030c00, rc 0) 00000100:00100000:0.0:1789708599.583347:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:5816:x1876645426244224:12345-0@lo:101: Request processed in 99us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708599.583353:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789708599.583376:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426243968 00000100:00100000:0.0:1789708599.583379:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426243968 00000100:00100000:0.0:1789708599.583398:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426244096 00000100:00100000:0.0:1789708599.583400:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426244096 00000100:00100000:0.0:1789708599.583415:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789708599.583421:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426243968:12345-0@lo:400: 00000100:00100000:0.0:1789708599.583457:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426243968:12345-0@lo:400: Request processed in 35us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708599.583464:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789708599.583474:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708599.583478:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426244096:12345-0@lo:400: 00000100:00100000:0.0:1789708599.583502:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426244096:12345-0@lo:400: Request processed in 24us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708599.583505:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708599.583523:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e163800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426244224:0@lo:101: 00010000:00010000:0.0:1789708599.583530:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865fa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865fa7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708599.583536:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865fa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865fa7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708599.583563:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e163800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426244352:0@lo:501: 00000100:00100000:0.0:1789708599.583583:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708599.583591:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405876f00 going to sleep for 11 seconds 00010000:00080000:0.0:1789708599.583610:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a143e163b80 x1876645426243968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708599.583617:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426243968:0@lo:400: 00010000:00080000:0.0:1789708599.583629:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a143e162a00 x1876645426244096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708599.583635:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426244096:0@lo:400: 00000100:00100000:0.0:1789708599.583643:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426244352 00000100:00100000:0.0:1789708599.583645:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426244352 00000100:00100000:0.0:1789708599.583679:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789708599.583683:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140309fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:5816:x1876645426244352:12345-0@lo:501: 00000100:00100000:0.0:1789708599.583824:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140309fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:5816:x1876645426244352:12345-0@lo:501: Request processed in 140us (239us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789708599.583829:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789708599.583850:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e163800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426244352:0@lo:501: 10000000:01000000:0.0:1789708599.583868:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789708599.583874:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865fa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865fa7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708599.583881:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865fa7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708599.584025:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426243712 00000100:00100000:1.0:1789708599.584029:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426243712 00000100:00100000:1.0:1789708599.584050:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789708599.584053:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410808380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1876645426243712:12345-0@lo:8: 00010000:00080000:1.0:1789708599.584070:0:6670:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:1.0:1789708599.584090:0:6670:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa8f741d1c6865fae 00002000:00100000:1.0:1789708599.584121:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a1306f83000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789708599.584126:0:6670:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1789708599.584130:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789708599.584223:0:6670:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789708599.584372:0:6670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789708599.584393:0:6670:0:(import.c:65:import_set_state_nolock()) ffff8a1306f82000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708599.584435:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410808380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1876645426243712:12345-0@lo:8: Request processed in 379us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708599.584442:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789708599.584547:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1427030a80 x1876645426243712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789708609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708599.584555:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789708599.584569:0:3285:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789708599.584577:0:3285:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789708599.584582:0:3285:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789708599.584585:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a1410964800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789708599.584642:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789708599.584670:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426243712:0@lo:8: 00000004:00080000:2.0:1789708599.592230:0:7163:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789708599.592563:0:7163:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 165389912296ns, next at 0ns, rc = 0 00000004:00080000:2.0:1789708599.625878:0:7164:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789708599.625920:0:7164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1410808000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7164:1876645426244608:0@lo:7: 00000100:00100000:2.0:1789708599.625996:0:7164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708599.626038:0:7164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1410bfb840 going to sleep for 11 seconds 00000100:00100000:2.0:1789708599.626053:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426244480:0@lo:13: 00000100:00100000:2.0:1789708599.626076:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708599.626116:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426244608 00000100:00100000:2.0:1789708599.626123:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426244608 00000100:00080000:1.0:1789708599.626182:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708599.626184:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789708599.626195:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410809880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7164:x1876645426244608:12345-0@lo:7: 00000100:00100000:0.0:1789708599.629025:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426244480 00000100:00100000:0.0:1789708599.629038:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426244480 00000100:00100000:0.0:1789708599.629098:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708599.629109:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410809180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1876645426244480:12345-0@lo:13: 00002000:00000024:0.0:1789708599.629142:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789708599.629224:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410809180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1876645426244480:12345-0@lo:13: Request processed in 116us (3145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708599.629232:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789708599.635873:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a141080ad80 x1876645426244480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708599.635899:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426244480:0@lo:13: 00002000:00080000:2.0:1789708599.639496:0:6673:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789708599.639505:0:6673:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789708599.639597:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410809880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7164:x1876645426244608:12345-0@lo:7: Request processed in 13399us (13597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708599.639607:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789708599.639741:0:7164:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1410808000 x1876645426244608/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789708615 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708599.639763:0:7164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1410808000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7164:1876645426244608:0@lo:7: 00000004:00080000:0.0:1789708599.639777:0:7164:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789708599.639815:0:7164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e163800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7164:1876645426244736:0@lo:5: 00000100:00100000:0.0:1789708599.639849:0:7164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708599.639894:0:7164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14058760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708599.639965:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426244736 00000100:00100000:2.0:1789708599.639972:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426244736 00000100:00100000:2.0:1789708599.640021:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789708599.640032:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7164:x1876645426244736:12345-0@lo:5: 00002000:00080000:2.0:1789708599.640059:0:6672:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789708599.640063:0:6672:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789708599.640283:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7164:x1876645426244736:12345-0@lo:5: Request processed in 253us (432us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789708599.640290:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789708599.640421:0:7164:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a143e163800 x1876645426244736/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789708615 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708599.640435:0:7164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e163800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7164:1876645426244736:0@lo:5: 00000004:00080000:1.0:1789708599.640724:0:7164:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789708599.640756:0:7164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427030700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7164:1876645426244864:0@lo:700: 00000100:00100000:1.0:1789708599.640788:0:7164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708599.640813:0:7164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414ef8180 going to sleep for 11 seconds 00000100:00100000:0.0:1789708599.640911:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426244864 00000100:00100000:0.0:1789708599.640916:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426244864 00000100:00100000:0.0:1789708599.640963:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708599.640971:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7164:x1876645426244864:12345-0@lo:700: 00000100:00100000:0.0:1789708599.640997:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6679:1876645426244992:0@lo:700: 00000100:00100000:0.0:1789708599.641033:0:6679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708599.641058:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405876cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708599.641124:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426244992 00000100:00100000:2.0:1789708599.641134:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426244992 00000100:00100000:2.0:1789708599.641177:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708599.641185:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6679:x1876645426244992:12345-0@lo:700: 00000004:00080000:2.0:1789708599.671259:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:3.0:1789708599.686943:0:5826:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1789708599.689531:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6679:x1876645426244992:12345-0@lo:700: Request processed in 48341us (48489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708599.689550:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789708599.689797:0:6679:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a143e163b80 x1876645426244992/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789708615 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708599.689812:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6679:1876645426244992:0@lo:700: 40000000:02000000:0.0:1789708599.689825:0:6679:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:0.0:1789708599.731638:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789708599.731698:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1789708599.731835:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7164:x1876645426244864:12345-0@lo:700: Request processed in 90861us (91042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708599.731854:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789708599.731864:0:7164:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1427030700 x1876645426244864/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789708615 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708599.731876:0:7164:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789708599.731898:0:7164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427030700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7164:1876645426244864:0@lo:700: 00000004:02000040:1.0:1789708599.753113:0:7164:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1789708599.758596:0:7164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427030700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7164:1876645426245120:0@lo:5: 00000100:00100000:1.0:1789708599.758679:0:7164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708599.758719:0:7164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f632e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708599.758864:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426245120 00000100:00100000:2.0:1789708599.758870:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426245120 00000100:00100000:2.0:1789708599.758915:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789708599.758921:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7164:x1876645426245120:12345-0@lo:5: 00002000:00080000:2.0:1789708599.767793:0:6673:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789708599.767814:0:6673:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1789708599.773440:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7164:x1876645426245120:12345-0@lo:5: Request processed in 14512us (14755us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789708599.773454:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789708599.773572:0:7164:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1427030700 x1876645426245120/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789708615 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708599.773590:0:7164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427030700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7164:1876645426245120:0@lo:5: 00000004:00080000:1.0:1789708599.773603:0:7164:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1789708600.444033:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789708600.497095:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1789708601.467058:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708602.491589:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708603.514982:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789708603.666062:0:7611:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789708603.666065:0:7611:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789708603.666208:0:7611:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a1302f7e800 00000020:01000004:3.0:1789708603.666223:0:7611:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789708603.666235:0:7611:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789708603.666248:0:7611:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a143442b380) 00000020:00000080:3.0:1789708603.666262:0:7611:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789708603.679012:0:7611:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789708603.679264:0:7611:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789708603.698225:0:7611:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789708603.702752:0:7611:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789708603.702786:0:7611:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789708603.702840:0:7611:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789708603.702879:0:7611:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789708603.703212:0:7611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789708603.703223:0:7611:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789708603.703234:0:7611:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa8f741d1c6865fbc 00000020:01000004:3.0:1789708603.703241:0:7611:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789708603.703264:0:7611:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.153@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789708603.703268:0:7611:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789708603.703274:0:7611:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789708603.703307:0:7611:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789708603.703316:0:7611:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789708603.718630:0:7611:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789708603.718842:0:7611:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.153@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789708603.718846:0:7611:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789708603.718848:0:7611:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789708603.718850:0:7611:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708603.718851:0:7611:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708603.718852:0:7611:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708603.718854:0:7611:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708603.718855:0:7611:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789708603.718856:0:7611:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789708603.718858:0:7611:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789708603.718860:0:7611:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708603.718861:0:7611:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789708603.718865:0:7611:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789708603.718867:0:7611:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789708603.718869:0:7611:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789708603.718870:0:7611:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708603.718871:0:7611:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708603.718872:0:7611:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708603.718874:0:7611:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708603.718874:0:7611:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789708603.718875:0:7611:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789708603.718876:0:7611:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789708603.718877:0:7611:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708603.718879:0:7611:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789708603.718920:0:7611:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789708603.718939:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426245248:0@lo:253: 00000100:00100000:3.0:1789708603.719011:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708603.719108:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1302c29540 going to sleep for 11 seconds 00000100:00100000:0.0:1789708603.719150:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426245248 00000100:00100000:0.0:1789708603.719157:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426245248 00000100:00100000:0.0:1789708603.719211:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789708603.719220:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:7611:x1876645426245248:12345-0@lo:253: 20000000:01000000:0.0:1789708603.719247:0:5813:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789708603.719251:0:5813:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789708603.719256:0:5813:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789708603.719259:0:5813:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789708603.720534:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789708603.720846:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789708603.720860:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789708603.720899:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789708603.720916:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789708603.720951:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789708603.721004:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789708603.721447:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789708603.721466:0:5813:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.153@tcp 20000000:01000000:0.0:1789708603.721468:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:0.0:1789708603.721516:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789708603.721524:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789708603.721574:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789708603.721583:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:0.0:1789708603.721616:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789708603.721626:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789708603.721685:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789708603.721739:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789708603.722530:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1789708603.722545:0:5813:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.153@tcp 20000000:01000000:0.0:1789708603.722547:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:0.0:1789708603.722575:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1789708603.722581:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789708603.722605:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1789708603.722612:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:0.0:1789708603.722639:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1789708603.722646:0:5813:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789708603.722779:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1789708603.722820:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1789708603.722843:0:5813:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789708603.722846:0:5813:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789708603.722849:0:5813:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789708603.722861:0:5813:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789708603.722864:0:5813:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789708603.722894:0:5813:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789708603.722897:0:5813:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789708603.723355:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789708603.723465:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789708603.723521:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789708603.723896:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1789708603.723949:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1789708603.723988:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1789708603.724006:0:5813:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789708603.724008:0:5813:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789708603.724834:0:7614:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1789708603.724890:0:7614:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1789708603.724959:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1789708603.725181:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1789708603.725233:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1789708603.725288:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1789708603.725307:0:5813:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789708603.725309:0:5813:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789708603.725698:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789708603.725976:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789708603.726015:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789708603.726070:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789708603.726088:0:5813:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789708603.726091:0:5813:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789708603.726641:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1789708603.726736:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1789708603.726772:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1789708603.727162:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1789708603.727207:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1789708603.727260:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1789708603.727281:0:5813:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1789708603.727284:0:5813:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1789708603.727293:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789708603.727312:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1400030200/0xa8f741d1c6865fc3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.727330:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a14013a1c00/0xa8f741d1c6865f14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865f0d expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.727339:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1400030a00/0xa8f741d1c6865f3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865f37 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.727346:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a14013a0600/0xa8f741d1c6865f68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865f61 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.727354:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1403b6b600/0xa8f741d1c6865f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865f7d expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.727360:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865fa0 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.727367:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1400030200/0xa8f741d1c6865fc3 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.727419:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6865fa0 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.727439:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865fa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6865fa0 expref: 16 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708603.727454:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1876645426245376:0@lo:104: 00000100:00100000:0.0:1789708603.727521:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789708603.727574:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1403b6b600/0xa8f741d1c6865f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6865f7d expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.727583:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1403b6b600/0xa8f741d1c6865f84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6865f7d expref: 16 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708603.727591:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e161f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1876645426245504:0@lo:104: 00010000:00010000:0.0:1789708603.727613:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a14013a0600/0xa8f741d1c6865f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6865f61 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.727620:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a14013a0600/0xa8f741d1c6865f68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6865f61 expref: 16 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708603.727628:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e160380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1876645426245632:0@lo:104: 00010000:00010000:0.0:1789708603.727646:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1400030a00/0xa8f741d1c6865f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6865f37 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.727674:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1400030a00/0xa8f741d1c6865f3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6865f37 expref: 16 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708603.727682:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e162d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1876645426245760:0@lo:104: 00010000:00010000:0.0:1789708603.727705:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a14013a1c00/0xa8f741d1c6865f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6865f0d expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.727722:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a14013a1c00/0xa8f741d1c6865f14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6865f0d expref: 16 pid: 5813 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708603.727730:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e160000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1876645426245888:0@lo:104: 00000100:00100000:0.0:1789708603.727748:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f905240 going to sleep for 11 seconds 00000100:00100000:1.0:1789708603.727814:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789708603.727831:0:5803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708603.727854:0:5803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708603.727862:0:5803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708603.727869:0:5803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708603.727880:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426245376 00000100:00100000:1.0:1789708603.727887:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426245376 00000100:00100000:1.0:1789708603.727925:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426245504 00000100:00100000:1.0:1789708603.727929:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426245504 00000100:00100000:1.0:1789708603.727941:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426245632 00000100:00100000:1.0:1789708603.727943:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426245632 00000100:00100000:1.0:1789708603.727951:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426245760 00000100:00100000:1.0:1789708603.727953:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426245760 00000100:00100000:1.0:1789708603.727962:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426245888 00000100:00100000:1.0:1789708603.727964:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426245888 00000100:00100000:1.0:1789708603.727976:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789708603.727984:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1407620450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+7:5813:x1876645426245376:12345-0@lo:104: 00010000:00010000:1.0:1789708603.727996:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865fa7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728057:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789708603.728063:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1407620450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+7:5813:x1876645426245376:12345-0@lo:104: Request processed in 79us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.728070:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789708603.728113:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789708603.728119:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427031500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+6:5813:x1876645426245504:12345-0@lo:104: 00010000:00010000:1.0:1789708603.728126:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865f7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865f84 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728158:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789708603.728163:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427031500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+6:5813:x1876645426245504:12345-0@lo:104: Request processed in 45us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.728168:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789708603.728180:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789708603.728186:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427032300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+5:5813:x1876645426245632:12345-0@lo:104: 00010000:00010000:1.0:1789708603.728193:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1403b6aa00/0xa8f741d1c6865f61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865f68 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728217:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789708603.728221:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427032300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+5:5813:x1876645426245632:12345-0@lo:104: Request processed in 36us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.728226:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789708603.728236:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789708603.728241:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427030a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+4:5813:x1876645426245760:12345-0@lo:104: 00010000:00010000:1.0:1789708603.728247:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1401691200/0xa8f741d1c6865f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865f3e expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728275:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789708603.728279:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427030a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+4:5813:x1876645426245760:12345-0@lo:104: Request processed in 38us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.728284:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789708603.728296:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789708603.728301:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427031180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:5813:x1876645426245888:12345-0@lo:104: 00010000:00010000:1.0:1789708603.728307:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6865f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865f14 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728329:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789708603.728334:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427031180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:5813:x1876645426245888:12345-0@lo:104: Request processed in 33us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.728338:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789708603.728354:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789708603.728359:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865fa7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728366:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400031000 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:1.0:1789708603.728370:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6865fa7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728378:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6865fa7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708603.728384:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6865fa7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708603.728389:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789708603.728425:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865fa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865fa7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728432:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789708603.728450:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865fa0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865fa7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728456:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1400031000/0xa8f741d1c6865fa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865fa7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728470:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789708603.728474:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865f7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865f84 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728479:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400030000 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:1.0:1789708603.728482:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865f7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6865f84 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728488:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6865f84 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708603.728494:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6865f84 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708603.728499:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789708603.728511:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865f7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865f84 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728517:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789708603.728522:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865f7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865f84 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728537:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1400030000/0xa8f741d1c6865f7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865f84 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728547:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789708603.728550:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1403b6aa00/0xa8f741d1c6865f61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865f68 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728555:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6aa00 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:1.0:1789708603.728558:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1403b6aa00/0xa8f741d1c6865f61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6865f68 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728564:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1403b6aa00/0xa8f741d1c6865f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6865f68 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708603.728570:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1403b6aa00/0xa8f741d1c6865f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6865f68 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708603.728575:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789708603.728588:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1403b6aa00/0xa8f741d1c6865f61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865f68 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728593:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789708603.728607:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1403b6aa00/0xa8f741d1c6865f61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865f68 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728614:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1403b6aa00/0xa8f741d1c6865f61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865f68 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728623:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789708603.728632:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1401691200/0xa8f741d1c6865f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865f3e expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728637:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1401691200 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:1.0:1789708603.728640:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1401691200/0xa8f741d1c6865f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6865f3e expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728675:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1401691200/0xa8f741d1c6865f37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6865f3e expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708603.728683:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1401691200/0xa8f741d1c6865f37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6865f3e expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708603.728688:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789708603.728700:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1401691200/0xa8f741d1c6865f37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865f3e expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728706:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789708603.728711:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1401691200/0xa8f741d1c6865f37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865f3e expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728717:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1401691200/0xa8f741d1c6865f37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865f3e expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728726:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708603.728729:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6865f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865f14 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728734:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1401690e00 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:1.0:1789708603.728736:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6865f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6865f14 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728752:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6865f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6865f14 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708603.728759:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6865f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6865f14 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708603.728764:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789708603.728774:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6865f0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865f14 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728779:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789708603.728783:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6865f0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865f14 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728789:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6865f0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865f14 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.728802:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708603.728805:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708603.728806:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708603.728813:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708603.728831:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426246016:0@lo:103: 00000100:00100000:1.0:1789708603.728865:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708603.728903:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426246528:0@lo:103: 00000100:00100000:1.0:1789708603.728933:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708603.728964:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708603.728970:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426246144:0@lo:103: 00000100:00100000:1.0:1789708603.728990:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708603.729031:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426246272:0@lo:103: 00000100:00100000:1.0:1789708603.729063:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708603.729077:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789708603.729082:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426246400:0@lo:103: 00000100:00100000:1.0:1789708603.729100:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708603.729132:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426246016 00000100:00100000:1.0:1789708603.729136:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426246016 00010000:00010000:1.0:1789708603.729152:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865fa7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865fa0 expref: 17 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.729167:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426246528 00000100:00100000:1.0:1789708603.729170:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426246528 00010000:00010000:1.0:1789708603.729179:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a14013a1c00/0xa8f741d1c6865f14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865f0d expref: 18 pid: 5813 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.729190:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426246144 00000100:00100000:1.0:1789708603.729193:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426246144 00010000:00010000:1.0:1789708603.729202:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1403b6b600/0xa8f741d1c6865f84 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865f7d expref: 19 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.729212:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426246272 00000100:00100000:1.0:1789708603.729214:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426246272 00010000:00010000:1.0:1789708603.729223:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a14013a0600/0xa8f741d1c6865f68 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865f61 expref: 20 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.729233:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426246400 00000100:00100000:1.0:1789708603.729235:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426246400 00010000:00010000:1.0:1789708603.729244:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1400030a00/0xa8f741d1c6865f3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865f37 expref: 21 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.729256:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789708603.729262:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427030380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+21:3286:x1876645426246016:12345-0@lo:103: 00010000:00010000:1.0:1789708603.729278:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708603.729284:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865fa7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865fa0 expref: 21 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729294:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865fa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6865fa0 expref: 21 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729308:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708603.729343:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427030380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+21:3286:x1876645426246016:12345-0@lo:103: Request processed in 81us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.729350:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789708603.729363:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789708603.729370:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427031f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+20:3286:x1876645426246528:12345-0@lo:103: 00010000:00010000:1.0:1789708603.729378:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708603.729383:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a14013a1c00/0xa8f741d1c6865f14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865f0d expref: 20 pid: 5813 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729391:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a14013a1c00/0xa8f741d1c6865f14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6865f0d expref: 20 pid: 5813 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.729399:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426246016:0@lo:103: 00010000:00010000:1.0:1789708603.729401:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708603.729428:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427031f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+20:3286:x1876645426246528:12345-0@lo:103: Request processed in 58us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.729435:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789708603.729439:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426246528:0@lo:103: 00000100:00100000:1.0:1789708603.729452:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789708603.729461:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427033480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3286:x1876645426246144:12345-0@lo:103: 00010000:00010000:1.0:1789708603.729468:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708603.729472:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1403b6b600/0xa8f741d1c6865f84 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865f7d expref: 19 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729484:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1403b6b600/0xa8f741d1c6865f84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6865f7d expref: 19 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729493:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708603.729525:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427033480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3286:x1876645426246144:12345-0@lo:103: Request processed in 67us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.729531:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789708603.729542:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789708603.729548:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308529f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:3288:x1876645426246272:12345-0@lo:103: 00010000:00010000:1.0:1789708603.729555:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708603.729559:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a14013a0600/0xa8f741d1c6865f68 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865f61 expref: 18 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729567:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a14013a0600/0xa8f741d1c6865f68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6865f61 expref: 18 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729575:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708603.729599:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308529f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:3288:x1876645426246272:12345-0@lo:103: Request processed in 52us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.729605:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789708603.729616:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789708603.729621:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308528380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:3288:x1876645426246400:12345-0@lo:103: 00010000:00010000:1.0:1789708603.729628:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708603.729632:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1400030a00/0xa8f741d1c6865f3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865f37 expref: 17 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729641:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1400030a00/0xa8f741d1c6865f3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6865f37 expref: 17 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729678:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1400030200/0xa8f741d1c6865fc3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729687:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400030200/0xa8f741d1c6865fc3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729701:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1400030200/0xa8f741d1c6865fc3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729707:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1400030200/0xa8f741d1c6865fc3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729713:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1400030200/0xa8f741d1c6865fc3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729720:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1400030200/0xa8f741d1c6865fc3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729726:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400030200 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708603.729729:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1400030200/0xa8f741d1c6865fc3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729737:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1400030200/0xa8f741d1c6865fc3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729746:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1400030200/0xa8f741d1c6865fc3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729754:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708603.729778:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308528380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:3288:x1876645426246400:12345-0@lo:103: Request processed in 156us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.729793:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789708603.729823:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426246400:0@lo:103: 00000100:00100000:1.0:1789708603.729831:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426246272:0@lo:103: 00010000:00010000:1.0:1789708603.729860:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400030c00/0xa8f741d1c6865fa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6865fa0 expref: 16 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.729871:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1876645426245376:0@lo:104: 00010000:00010000:1.0:1789708603.729882:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1403b6b600/0xa8f741d1c6865f84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6865f7d expref: 15 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.729889:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e161f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1876645426245504:0@lo:104: 00010000:00010000:1.0:1789708603.729897:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a14013a0600/0xa8f741d1c6865f68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6865f61 expref: 14 pid: 5812 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.729916:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e160380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1876645426245632:0@lo:104: 00010000:00010000:1.0:1789708603.729927:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400030a00/0xa8f741d1c6865f3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6865f37 expref: 13 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.729936:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e162d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1876645426245760:0@lo:104: 00010000:00010000:1.0:1789708603.729943:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a14013a1c00/0xa8f741d1c6865f14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6865f0d expref: 12 pid: 5813 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.729951:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e160000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5813:1876645426245888:0@lo:104: 00010000:00010000:1.0:1789708603.729971:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1400030200/0xa8f741d1c6865fc3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729990:0:5813:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1400030200/0xa8f741d1c6865fc3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.729996:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1400030200/0xa8f741d1c6865fc3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.730002:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400030200/0xa8f741d1c6865fc3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789708603.730014:0:5813:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789708603.730087:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426246144:0@lo:103: 00000100:00100000:2.0:1789708603.759607:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:7611:x1876645426245248:12345-0@lo:253: Request processed in 40379us (40586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708603.759622:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789708603.759645:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426245248:0@lo:253: 10000000:01000000:3.0:1789708603.759700:0:7611:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789708603.759703:0:7611:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789708603.759705:0:7611:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789708603.759706:0:7611:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708603.759707:0:7611:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789708603.759721:0:7611:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708603.759722:0:7611:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708603.759723:0:7611:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789708603.759725:0:7611:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789708603.759726:0:7611:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708603.759727:0:7611:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789708603.759751:0:7611:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a1302f7e800 from lustre-OST0001 10000000:01000000:3.0:1789708603.759771:0:7611:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789708603.759773:0:7611:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789708603.759779:0:7611:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a1407ea19c0 local copy 10000000:01000000:3.0:1789708603.759783:0:7611:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789708603.759812:0:7611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865fca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.759821:0:7611:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865fca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.759829:0:7611:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865fca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708603.759842:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426246656:0@lo:101: 00000100:00100000:3.0:1789708603.759873:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708603.759930:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1302c29a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708603.759973:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426246656 00000100:00100000:2.0:1789708603.759980:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426246656 00000100:00100000:2.0:1789708603.760059:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789708603.760069:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+11:7611:x1876645426246656:12345-0@lo:101: 00010000:00010000:2.0:1789708603.760080:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708603.760095:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1403b6b400/0xa8f741d1c6865fd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865fca expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.760118:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1403b6b400/0xa8f741d1c6865fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865fca expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.760129:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1403b6b400/0xa8f741d1c6865fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865fca expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.760137:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6b400, rc 0) 00000100:00100000:2.0:1789708603.760177:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:7611:x1876645426246656:12345-0@lo:101: Request processed in 110us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708603.760183:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789708603.760305:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426246656:0@lo:101: 00010000:00010000:3.0:1789708603.760315:0:7611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865fca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa8f741d1c6865fd1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.760323:0:7611:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865fca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa8f741d1c6865fd1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708603.760404:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426246784:0@lo:501: 00000100:00100000:3.0:1789708603.760423:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708603.760442:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1302c29a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708603.760468:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426246784 00000100:00100000:2.0:1789708603.760473:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426246784 00000100:00100000:2.0:1789708603.760584:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789708603.760593:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:7611:x1876645426246784:12345-0@lo:501: 00000100:00100000:2.0:1789708603.760808:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:7611:x1876645426246784:12345-0@lo:501: Request processed in 216us (382us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789708603.760816:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789708603.760833:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426246784:0@lo:501: 10000000:01000000:3.0:1789708603.760843:0:7611:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789708603.760861:0:7611:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789708603.760865:0:7611:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865fca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa8f741d1c6865fd1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.760871:0:7611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865fca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa8f741d1c6865fd1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.760875:0:7611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865fca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa8f741d1c6865fd1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.760896:0:7611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789708603.760925:0:7611:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a1302f7e800 10000000:01000000:3.0:1789708603.760930:0:7611:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789708603.760936:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1789708603.760937:0:7611:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789708603.760942:0:7611:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789708603.760947:0:7611:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 00010000:00010000:1.0:1789708603.760947:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865fca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa8f741d1c6865fd1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708603.760954:0:7611:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789708603.760961:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1401691a00 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:1.0:1789708603.760965:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865fca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa8f741d1c6865fd1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.760972:0:7611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401691800/0xa8f741d1c6865fd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.760981:0:7611:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1401691800/0xa8f741d1c6865fd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.760983:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865fca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0xa8f741d1c6865fd1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.760997:0:7611:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1401691800/0xa8f741d1c6865fd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708603.760999:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865fca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0xa8f741d1c6865fd1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708603.761015:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789708603.761020:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426246912:0@lo:101: 00010000:00010000:1.0:1789708603.761037:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865fca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa8f741d1c6865fd1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.761044:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789708603.761053:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708603.761072:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1302c29a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708603.761099:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130852ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426247040:0@lo:103: 00000100:00100000:0.0:1789708603.761133:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708603.761174:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865fca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa8f741d1c6865fd1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.761187:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1401691a00/0xa8f741d1c6865fca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa8f741d1c6865fd1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.761199:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708603.761201:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708603.761203:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708603.761224:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426247040 00000100:00100000:1.0:1789708603.761228:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426247040 00000100:00100000:3.0:1789708603.761245:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426246912 00000100:00100000:3.0:1789708603.761250:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426246912 00000100:00100000:1.0:1789708603.761266:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708603.761277:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e160000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:3287:x1876645426247040:12345-0@lo:103: 00000100:00100000:3.0:1789708603.761278:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789708603.761288:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:7611:x1876645426246912:12345-0@lo:101: 00010000:00010000:1.0:1789708603.761292:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708603.761294:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708603.761303:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1401691400/0xa8f741d1c6865fdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865fd8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.761307:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1403b6b400/0xa8f741d1c6865fd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa8f741d1c6865fca expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.761317:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1401691400/0xa8f741d1c6865fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865fd8 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.761459:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708603.761460:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1401691400/0xa8f741d1c6865fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865fd8 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.761468:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1401691400, rc 0) 00000100:00100000:3.0:1789708603.761567:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:7611:x1876645426246912:12345-0@lo:101: Request processed in 281us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708603.761572:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789708603.761622:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426246912:0@lo:101: 00010000:00010000:2.0:1789708603.761635:0:7611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1401691800/0xa8f741d1c6865fd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865fdf expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.761643:0:7611:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1401691800/0xa8f741d1c6865fd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865fdf expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708603.761736:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426247168:0@lo:501: 00000100:00100000:2.0:1789708603.761763:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708603.761795:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14349e5600 going to sleep for 11 seconds 00000100:00100000:3.0:1789708603.761796:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426247168 00000100:00100000:3.0:1789708603.761801:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426247168 00000100:00100000:3.0:1789708603.761819:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789708603.761823:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:7611:x1876645426247168:12345-0@lo:501: 00000100:00100000:1.0:1789708603.761904:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e160000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:3287:x1876645426247040:12345-0@lo:103: Request processed in 630us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.761922:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789708603.761985:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:7611:x1876645426247168:12345-0@lo:501: Request processed in 160us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708603.761990:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789708603.762033:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426247168:0@lo:501: 00000100:00100000:1.0:1789708603.762072:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426247296:0@lo:503: 00000100:00100000:1.0:1789708603.762108:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708603.762125:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1404e83f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789708603.762138:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426247296 00000100:00100000:3.0:1789708603.762145:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426247296 00000100:00100000:3.0:1789708603.762169:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789708603.762173:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:7611:x1876645426247296:12345-0@lo:503: 00000100:00100000:3.0:1789708603.762284:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:7611:x1876645426247296:12345-0@lo:503: Request processed in 110us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708603.762289:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789708603.762296:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130852ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426247040:0@lo:103: 00000100:00100000:1.0:1789708603.762355:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426247296:0@lo:503: 00000040:00080000:1.0:1789708603.762715:0:7611:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789708603.762771:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426247424:0@lo:502: 00000100:00100000:1.0:1789708603.762807:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708603.762844:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1404e83f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789708603.762849:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426247424 00000100:00100000:3.0:1789708603.762853:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426247424 00000100:00100000:3.0:1789708603.762868:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789708603.762872:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:7611:x1876645426247424:12345-0@lo:502: 00000100:00100000:3.0:1789708603.763056:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:7611:x1876645426247424:12345-0@lo:502: Request processed in 181us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.763056:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426247424:0@lo:502: 00000100:00100000:3.0:1789708603.763070:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000040:00080000:1.0:1789708603.763935:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789708603.763985:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789708603.764022:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789708603.764066:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789708603.764111:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789708603.764144:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789708603.764169:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426247552:0@lo:502: 00000100:00100000:1.0:1789708603.764211:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708603.764441:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1404e83f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789708603.764448:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426247552 00000100:00100000:3.0:1789708603.764452:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426247552 00000100:00100000:3.0:1789708603.764487:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789708603.764494:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:7611:x1876645426247552:12345-0@lo:502: 00000100:00100000:3.0:1789708603.764623:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:7611:x1876645426247552:12345-0@lo:502: Request processed in 130us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708603.764627:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789708603.764678:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426247552:0@lo:502: 00000040:00080000:1.0:1789708603.764757:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789708603.764766:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789708603.765270:0:7617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789708603.765276:0:7617:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789708603.765282:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708603.765283:0:7617:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789708603.765287:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789708603.765370:0:7617:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a14344299c0) 00000020:00000080:3.0:1789708603.765388:0:7617:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789708603.765393:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789708603.765446:0:7617:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1302f7e800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789708603.765451:0:7617:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789708603.765455:0:7617:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa8f741d1c6865fed 00010000:00010000:3.0:1789708603.768668:0:7617:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1789708603.769007:0:7617:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789708603.770640:0:7617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789708603.770926:0:7617:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1789708603.772979:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789708603.773407:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789708603.774511:0:7617:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789708603.774522:0:7617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708603.774528:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708603.774530:0:7617:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789708603.774533:0:7617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708603.774537:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708603.774538:0:7617:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789708603.774541:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789708603.774543:0:7617:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789708603.774590:0:7617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708603.774595:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708603.774596:0:7617:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789708603.774600:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789708603.774799:0:7611:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789708603.774826:0:7611:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789708603.774845:0:7611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401691800/0xa8f741d1c6865fd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865fdf expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.774854:0:7611:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1401691800/0xa8f741d1c6865fd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865fdf expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708603.774860:0:7611:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1302f7e800 from 1 10000000:01000000:1.0:1789708603.774862:0:7611:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789708603.774892:0:7611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a1c00/0xa8f741d1c6865ff4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.774897:0:7611:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a14013a1c00/0xa8f741d1c6865ff4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.774927:0:7611:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a14013a1c00/0xa8f741d1c6865ff4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.774954:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426247680:0@lo:101: 00000100:00100000:1.0:1789708603.775021:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708603.775103:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1404e83d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708603.775147:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426247680 00000100:00100000:3.0:1789708603.775154:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426247680 00000100:00100000:3.0:1789708603.775207:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789708603.775216:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:7611:x1876645426247680:12345-0@lo:101: 00010000:00010000:3.0:1789708603.775229:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708603.775241:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865ffb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6865ff4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.775263:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865ffb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6865ff4 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.775283:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865ffb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865ff4 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.775292:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1401691a00, rc 0) 00000100:00100000:3.0:1789708603.775375:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:7611:x1876645426247680:12345-0@lo:101: Request processed in 160us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708603.775382:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789708603.775445:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426247680:0@lo:101: 00010000:00010000:1.0:1789708603.775459:0:7611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a14013a1c00/0xa8f741d1c6865ff4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865ffb expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.775468:0:7611:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a14013a1c00/0xa8f741d1c6865ff4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865ffb expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.775563:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426247808:0@lo:501: 00000100:00100000:1.0:1789708603.775593:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708603.775643:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1404e83d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708603.775726:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426247808 00000100:00100000:3.0:1789708603.775730:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426247808 00000100:00100000:3.0:1789708603.775759:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789708603.775766:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:7611:x1876645426247808:12345-0@lo:501: 00000100:00100000:3.0:1789708603.776064:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:7611:x1876645426247808:12345-0@lo:501: Request processed in 296us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708603.776072:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789708603.776132:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426247808:0@lo:501: 00000100:00100000:1.0:1789708603.776176:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426247936:0@lo:503: 00000100:00100000:1.0:1789708603.776218:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708603.776295:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1404e83d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708603.776347:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426247936 00000100:00100000:3.0:1789708603.776352:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426247936 00000100:00100000:3.0:1789708603.776433:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789708603.776444:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:7611:x1876645426247936:12345-0@lo:503: 00000100:00100000:3.0:1789708603.776902:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:7611:x1876645426247936:12345-0@lo:503: Request processed in 460us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708603.776922:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789708603.777015:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426247936:0@lo:503: 00000040:00080000:3.0:1789708603.777331:0:7611:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789708603.777386:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426248064:0@lo:502: 00000100:00100000:3.0:1789708603.777429:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708603.777475:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405acb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708603.777495:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426248064 00000100:00100000:3.0:1789708603.777499:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426248064 00000100:00100000:3.0:1789708603.777529:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789708603.777538:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:7611:x1876645426248064:12345-0@lo:502: 00000100:00100000:3.0:1789708603.777746:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:7611:x1876645426248064:12345-0@lo:502: Request processed in 210us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708603.777752:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789708603.777791:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426248064:0@lo:502: 00000040:00080000:3.0:1789708603.778221:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789708603.778264:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789708603.778297:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426248192:0@lo:502: 00000100:00100000:3.0:1789708603.778335:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708603.778370:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402e6ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708603.778387:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426248192 00000100:00100000:3.0:1789708603.778390:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426248192 00000100:00100000:3.0:1789708603.778416:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789708603.778423:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:7611:x1876645426248192:12345-0@lo:502: 00000100:00100000:3.0:1789708603.778586:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:7611:x1876645426248192:12345-0@lo:502: Request processed in 163us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708603.778592:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789708603.778638:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426248192:0@lo:502: 00000040:00080000:3.0:1789708603.778706:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789708603.778712:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789708603.779003:0:7620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708603.779013:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708603.779015:0:7620:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789708603.779022:0:7620:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1302f7e800 00000020:00000080:3.0:1789708603.779032:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789708603.779061:0:7620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708603.779065:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708603.779067:0:7620:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789708603.779070:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789708603.779107:0:7611:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789708603.779132:0:7611:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708603.779148:0:7611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a1c00/0xa8f741d1c6865ff4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865ffb expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.779159:0:7611:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a14013a1c00/0xa8f741d1c6865ff4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865ffb expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708603.779197:0:7611:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789708603.779200:0:7611:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a1302f7e800 10000000:01000000:3.0:1789708603.779203:0:7611:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a1302f7e800 10000000:01000000:3.0:1789708603.779207:0:7611:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789708603.779213:0:7611:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1302f7e800 from 1 10000000:01000000:3.0:1789708603.779216:0:7611:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789708603.779237:0:7611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6866002 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.779245:0:7611:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6866002 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.779254:0:7611:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6866002 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708603.779265:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426248320:0@lo:101: 00000100:00100000:3.0:1789708603.779293:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708603.779311:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405acbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708603.779329:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426248320 00000100:00100000:3.0:1789708603.779334:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426248320 00000100:00100000:3.0:1789708603.779357:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789708603.779364:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:7611:x1876645426248320:12345-0@lo:101: 00010000:00010000:3.0:1789708603.779372:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708603.779385:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1401691200/0xa8f741d1c6866009 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6866002 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.779404:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1401691200/0xa8f741d1c6866009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6866002 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.779414:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1401691200/0xa8f741d1c6866009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6866002 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.779423:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1401691200, rc 0) 00000100:00100000:3.0:1789708603.779453:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:7611:x1876645426248320:12345-0@lo:101: Request processed in 89us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708603.779459:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789708603.779496:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426248320:0@lo:101: 00010000:00010000:3.0:1789708603.779507:0:7611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6866002 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866009 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.779515:0:7611:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6866002 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6866009 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708603.779575:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426248448:0@lo:501: 00000100:00100000:3.0:1789708603.779601:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708603.779615:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405acbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708603.779628:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426248448 00000100:00100000:3.0:1789708603.779638:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426248448 00000100:00100000:3.0:1789708603.779686:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789708603.779695:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:7611:x1876645426248448:12345-0@lo:501: 00000100:00100000:3.0:1789708603.779868:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:7611:x1876645426248448:12345-0@lo:501: Request processed in 175us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708603.779875:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789708603.780041:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426248448:0@lo:501: 00000100:00100000:3.0:1789708603.780077:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426248576:0@lo:503: 00000100:00100000:3.0:1789708603.780114:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708603.780184:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405acbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708603.780271:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426248576 00000100:00100000:1.0:1789708603.780276:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426248576 00000100:00100000:1.0:1789708603.780336:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789708603.780344:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:7611:x1876645426248576:12345-0@lo:503: 00000100:00100000:1.0:1789708603.780509:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:7611:x1876645426248576:12345-0@lo:503: Request processed in 165us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.780521:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789708603.780602:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426248576:0@lo:503: 00000040:00080000:0.0:1789708603.780898:0:7611:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789708603.780968:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e162d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426248704:0@lo:502: 00000100:00100000:0.0:1789708603.781009:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708603.781039:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f905240 going to sleep for 11 seconds 00000100:00100000:1.0:1789708603.781056:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426248704 00000100:00100000:1.0:1789708603.781061:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426248704 00000100:00100000:1.0:1789708603.781094:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789708603.781100:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:7611:x1876645426248704:12345-0@lo:502: 00000100:00100000:1.0:1789708603.781272:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:7611:x1876645426248704:12345-0@lo:502: Request processed in 171us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.781279:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789708603.781309:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e162d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426248704:0@lo:502: 00000040:00080000:0.0:1789708603.781552:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789708603.781610:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789708603.781681:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789708603.781737:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789708603.781801:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789708603.781877:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789708603.781957:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789708603.782021:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789708603.782096:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789708603.782153:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789708603.782196:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789708603.782354:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789708603.782408:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789708603.782448:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789708603.782506:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789708603.782561:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789708603.782614:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789708603.782700:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789708603.782744:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789708603.782788:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789708603.782844:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789708603.782890:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789708603.782988:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789708603.783056:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789708603.783100:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789708603.783145:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789708603.783201:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789708603.783337:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1789708603.783387:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789708603.783470:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1789708603.783556:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1789708603.783646:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1789708603.783719:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1789708603.783806:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1789708603.783854:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1789708603.783950:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1789708603.784031:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1789708603.784081:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e162d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426248832:0@lo:502: 00000100:00100000:0.0:1789708603.784156:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708603.784278:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f905240 going to sleep for 11 seconds 00000100:00100000:1.0:1789708603.784382:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426248832 00000100:00100000:1.0:1789708603.784390:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426248832 00000100:00100000:1.0:1789708603.784447:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789708603.784458:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:7611:x1876645426248832:12345-0@lo:502: 00000100:00100000:0.0:1789708603.784941:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:7611:x1876645426248832:12345-0@lo:502: Request processed in 485us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708603.784950:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789708603.784985:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e162d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426248832:0@lo:502: 00000040:00080000:3.0:1789708603.785069:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1789708603.785081:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1789708603.785579:0:7622:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789708603.785593:0:7622:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a143454cd40) 00000020:00000080:0.0:1789708603.785612:0:7622:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1789708603.785756:0:7622:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1302f7e800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789708603.785761:0:7622:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1302f7e800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789708603.785764:0:7622:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1302f7e800 3 00010000:00080000:0.0:1789708603.785795:0:7622:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1403090800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.153@tcp at head 00010000:00010000:0.0:1789708603.787417:0:7622:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1789708603.787637:0:7622:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789708603.787697:0:7622:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789708603.787707:0:7622:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa8f741d1c6866017 00000100:00080000:0.0:1789708603.787717:0:7622:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789708603.787727:0:7622:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a1403090800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1789708603.787760:0:7622:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a143e160380 x1876645426248960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789708603.787825:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1876645426248960:0@lo:38: 00000100:00100000:1.0:1789708603.787889:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708603.788324:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426248960 00000100:00100000:3.0:1789708603.788333:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426248960 00000100:00100000:3.0:1789708603.788366:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789708603.788372:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3285:x1876645426248960:12345-0@lo:38: 00010000:00080000:3.0:1789708603.788391:0:5820:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:3.0:1789708603.788417:0:5820:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa8f741d1c686601e 00000004:00100000:3.0:1789708603.788429:0:5820:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789708603.788457:0:5820:0:(import.c:65:import_set_state_nolock()) ffff8a1306ed5800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789708603.788716:0:7622:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789708603.790087:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789708603.790102:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1410808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426249344:0@lo:400: 00000100:00100000:2.0:1789708603.790154:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708603.790205:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426249344 00000100:00100000:2.0:1789708603.790212:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426249344 00000100:00100000:3.0:1789708603.790503:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876645426248960:12345-0@lo:38: Request processed in 2127us (2611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708603.790512:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789708603.790544:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708603.790555:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a141080a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426249344:12345-0@lo:400: 00000100:00100000:2.0:1789708603.790609:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a141080a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426249344:12345-0@lo:400: Request processed in 57us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708603.790616:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789708603.790687:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1410808e00 x1876645426249344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708603.790719:0:3287:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789708603.790738:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1410808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426249344:0@lo:400: 00010000:00080000:1.0:1789708603.790827:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a143e160380 x1876645426248960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708603.790837:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789708603.790844:0:3285:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789708603.790852:0:3285:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789708603.790856:0:3285:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789708603.790869:0:7624:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8a1410808a80 x1876645426249472/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708603.790880:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f632840 going to sleep for 0 seconds 00000100:00080000:1.0:1789708603.790880:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a1403090800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789708603.790890:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1876645426248960:0@lo:38: 00000040:00080000:0.0:1789708603.790895:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1789708603.790927:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426249088:0@lo:400: 00000100:00100000:2.0:1789708603.790945:0:7624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708603.790965:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708603.790976:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f632840 going to sleep for 11 seconds 00000100:00100000:1.0:1789708603.790996:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789708603.791012:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1410809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426249216:0@lo:400: 00000100:00100000:1.0:1789708603.791054:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789708603.791095:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708603.791097:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426249088 00000100:00100000:2.0:1789708603.791103:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426249088 00000100:00100000:1.0:1789708603.791109:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426249216 00000100:00100000:1.0:1789708603.791114:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426249216 00000100:00100000:2.0:1789708603.791135:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789708603.791145:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426249088:12345-0@lo:400: 00000100:00100000:1.0:1789708603.791154:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789708603.791165:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130852b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426249216:12345-0@lo:400: 00000100:00100000:2.0:1789708603.791188:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426249088:12345-0@lo:400: Request processed in 45us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708603.791210:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789708603.791211:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130852b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426249216:12345-0@lo:400: Request processed in 44us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708603.791280:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426249472 00000100:00100000:3.0:1789708603.791284:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426249472 00000100:00100000:1.0:1789708603.791295:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789708603.791318:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708603.791344:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789708603.791347:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1410809c00 x1876645426249216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708603.791350:0:5830:0:(service.c:3474:ptlrpc_start_thread()) mdt_fld[-1] started 2 min 2 max 256 00000100:00100000:2.0:1789708603.791358:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a141080bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:7624:x1876645426249472:12345-0@lo:901: 00000100:00100000:1.0:1789708603.791368:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1410809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426249216:0@lo:400: 00000100:00100000:3.0:1789708603.791369:0:5830:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_fld_0002' 00010000:00080000:1.0:1789708603.791390:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a141080b100 x1876645426249088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708603.791399:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426249088:0@lo:400: 00000020:01000000:3.0:1789708603.791449:0:7611:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789708603.791489:0:7611:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789708603.791508:0:7611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6866002 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866009 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708603.791521:0:7611:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6866002 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866009 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789708603.791592:0:7611:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789708603.791595:0:7611:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789708603.791597:0:7611:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708603.791598:0:7611:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708603.791599:0:7611:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708603.791600:0:7611:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708603.791602:0:7611:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789708603.791604:0:7611:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789708603.791605:0:7611:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789708603.791607:0:7611:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708603.791609:0:7611:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789708603.791613:0:7611:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789708603.791616:0:7611:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789708603.791617:0:7611:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789708603.791619:0:7611:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708603.791620:0:7611:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708603.791622:0:7611:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708603.791623:0:7611:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708603.791625:0:7611:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789708603.791631:0:7611:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789708603.791633:0:7611:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789708603.791634:0:7611:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708603.791636:0:7611:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1789708603.791838:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a141080bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:7624:x1876645426249472:12345-0@lo:901: Request processed in 485us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708603.791843:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789708603.791869:0:7624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1410808a80 x1876645426249472/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789708619 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708603.791876:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1410808a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7624:1876645426249472:0@lo:901: 10000000:01000000:3.0:1789708603.791994:0:7611:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789708603.792006:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426249600:0@lo:253: 00000100:00100000:3.0:1789708603.792049:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708603.792088:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1302c29d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708603.792954:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426249600 00000100:00100000:0.0:1789708603.792964:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426249600 00000100:00100000:0.0:1789708603.793000:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789708603.793009:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:7611:x1876645426249600:12345-0@lo:253: 20000000:01000000:0.0:1789708603.793034:0:5814:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789708603.793049:0:5814:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789708603.819862:0:5814:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789708603.819875:0:5814:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789708603.819895:0:5835:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789708603.819901:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789708603.820094:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866025 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.820124:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1403b6a800/0xa8f741d1c6865f76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865f6f expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.820149:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866025 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.820187:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1403b6a800/0xa8f741d1c6865f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6865f6f expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.820200:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1403b6a800/0xa8f741d1c6865f76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6865f6f expref: 14 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708603.820214:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e161f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5835:1876645426249728:0@lo:104: 00000100:00100000:0.0:1789708603.820275:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708603.820319:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426249728 00000100:00100000:2.0:1789708603.820328:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426249728 00000100:00100000:0.0:1789708603.820328:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f905d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708603.820390:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789708603.820400:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e163b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:5835:x1876645426249728:12345-0@lo:104: 00010000:00010000:2.0:1789708603.820414:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865f76 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.820526:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789708603.820533:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e163b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:5835:x1876645426249728:12345-0@lo:104: Request processed in 134us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708603.820542:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789708603.820572:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708603.820578:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865f76 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.820588:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400030800 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:2.0:1789708603.820592:0:5807:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6865f76 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.820600:0:5807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6865f76 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708603.820608:0:5807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6865f76 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708603.820614:0:5807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789708603.820643:0:5807:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865f6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865f76 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.820667:0:5807:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708603.820697:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865f6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865f76 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.820704:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c6865f6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865f76 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708603.820721:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708603.820724:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708603.820726:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708603.820740:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789708603.820749:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1410808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426249856:0@lo:103: 00000100:00100000:2.0:1789708603.820779:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708603.820862:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426249856 00000100:00100000:1.0:1789708603.820868:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426249856 00010000:00010000:1.0:1789708603.820888:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1403b6a800/0xa8f741d1c6865f76 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865f6f expref: 15 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.820966:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789708603.820974:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1408280050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:3286:x1876645426249856:12345-0@lo:103: 00010000:00010000:1.0:1789708603.820983:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708603.820988:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1403b6a800/0xa8f741d1c6865f76 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865f6f expref: 15 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.821021:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1403b6a800/0xa8f741d1c6865f76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6865f6f expref: 15 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.821034:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866025 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.821041:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866025 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789708603.821055:0:5806:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001931724s 00010000:00010000:1.0:1789708603.821059:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866025 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.821066:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866025 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.821071:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1403b6a800/0xa8f741d1c6865f76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6865f6f expref: 15 pid: 5814 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.821076:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866025 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.821087:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866025 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708603.821088:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e161f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5835:1876645426249728:0@lo:104: 00010000:00010000:1.0:1789708603.821100:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400031600 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708603.821104:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866025 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.821110:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866025 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.821112:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866025 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.821131:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866025 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708603.821151:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708603.821154:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866025 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.821163:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866025 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708603.821170:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866025 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708603.821191:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1408280050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:3286:x1876645426249856:12345-0@lo:103: Request processed in 217us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.821199:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789708603.821261:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1410808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426249856:0@lo:103: 00000100:00100000:1.0:1789708603.826228:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:7611:x1876645426249600:12345-0@lo:253: Request processed in 33213us (34170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708603.826245:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789708603.826265:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34efb293-a6d4-48d2-a113-9ec9a49feb73:7611:1876645426249600:0@lo:253: 10000000:01000000:3.0:1789708603.826283:0:7611:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789708603.826286:0:7611:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789708603.826289:0:7611:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789708603.826290:0:7611:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708603.826301:0:7611:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708603.826302:0:7611:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708603.826303:0:7611:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708603.826305:0:7611:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789708603.826306:0:7611:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789708603.826308:0:7611:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789708603.826310:0:7611:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708603.826311:0:7611:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789708603.826339:0:7611:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789708603.830722:0:7611:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789708603.830874:0:7611:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789708603.831137:0:7611:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789708603.831365:0:7611:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789708603.831675:0:7611:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789708603.831892:0:7611:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789708603.832902:0:7611:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789708603.934077:0:7611:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789708603.934085:0:7611:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789708603.934123:0:7611:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789708603.934184:0:7611:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789708603.934202:0:7611:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789708603.934240:0:7611:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789708604.541111:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708604.667953:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426249984:0@lo:13: 00000100:00100000:3.0:1789708604.668020:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708604.668167:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426249984 00000100:00100000:0.0:1789708604.668179:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426249984 00000100:00100000:0.0:1789708604.668232:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708604.668242:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426249984:12345-0@lo:13: 00002000:00000024:0.0:1789708604.668275:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789708604.668320:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426249984:12345-0@lo:13: Request processed in 80us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708604.668327:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789708604.668364:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14037b9500 x1876645426249984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708604.668382:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426249984:0@lo:13: 10000000:01000000:1.0:1789708605.116992:0:5816:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789708605.116999:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a143fa6b000 from 30 10000000:01000000:1.0:1789708605.117005:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789708605.117047:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c686602c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.117166:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c686602c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.117180:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c686602c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708605.117204:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308529f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426250112:0@lo:101: 00000100:00100000:1.0:1789708605.117277:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708605.117339:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426250112 00000100:00100000:1.0:1789708605.117342:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308387a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708605.117349:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426250112 00000100:00100000:3.0:1789708605.117412:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789708605.117422:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:5816:x1876645426250112:12345-0@lo:101: 00010000:00010000:3.0:1789708605.117435:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708605.117448:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6866033 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c686602c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.117471:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6866033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c686602c expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.117488:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6866033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686602c expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.117497:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39200, rc 0) 00000100:00100000:3.0:1789708605.117557:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:5816:x1876645426250112:12345-0@lo:101: Request processed in 136us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708605.117564:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789708605.117590:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308529f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426250112:0@lo:101: 00010000:00010000:1.0:1789708605.117605:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c686602c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866033 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.117622:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c686602c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6866033 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708605.117709:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308529f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426250240:0@lo:501: 00000100:00100000:1.0:1789708605.117735:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708605.117760:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308387a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708605.117771:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426250240 00000100:00100000:3.0:1789708605.117777:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426250240 00000100:00100000:3.0:1789708605.117809:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789708605.117816:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:5816:x1876645426250240:12345-0@lo:501: 00000100:00100000:3.0:1789708605.118213:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:5816:x1876645426250240:12345-0@lo:501: Request processed in 396us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708605.118221:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789708605.118399:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308529f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426250240:0@lo:501: 00000100:00100000:1.0:1789708605.118441:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308529f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426250368:0@lo:503: 00000100:00100000:1.0:1789708605.118487:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708605.118511:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308387a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708605.118565:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426250368 00000100:00100000:3.0:1789708605.118570:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426250368 00000100:00100000:3.0:1789708605.118605:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789708605.118613:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:5816:x1876645426250368:12345-0@lo:503: 00000100:00100000:3.0:1789708605.118998:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:5816:x1876645426250368:12345-0@lo:503: Request processed in 385us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708605.119006:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789708605.119173:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308529f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426250368:0@lo:503: 00000100:00100000:3.0:1789708605.119864:0:7743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7743:1876645426250496:0@lo:502: 00000100:00100000:3.0:1789708605.119914:0:7743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708605.119943:0:7743:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140363ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708605.119956:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426250496 00000100:00100000:1.0:1789708605.119962:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426250496 00000100:00100000:1.0:1789708605.119999:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789708605.120006:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:7743:x1876645426250496:12345-0@lo:502: 00000100:00100000:1.0:1789708605.120267:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:7743:x1876645426250496:12345-0@lo:502: Request processed in 262us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708605.120275:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789708605.120315:0:7743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7743:1876645426250496:0@lo:502: 00000100:00100000:3.0:1789708605.120359:0:7743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7743:1876645426250624:0@lo:502: 00000100:00100000:3.0:1789708605.120392:0:7743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708605.120411:0:7743:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140363ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708605.120570:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426250624 00000100:00100000:1.0:1789708605.120575:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426250624 00000100:00100000:1.0:1789708605.120605:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789708605.120620:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:7743:x1876645426250624:12345-0@lo:502: 00000100:00100000:1.0:1789708605.120992:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:7743:x1876645426250624:12345-0@lo:502: Request processed in 380us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708605.120999:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789708605.121024:0:7743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7743:1876645426250624:0@lo:502: 00000040:00080000:3.0:1789708605.121047:0:7743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789708605.121146:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789708605.121171:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789708605.121179:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c686602c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866033 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.121188:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c686602c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866033 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708605.121198:0:5816:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789708605.121200:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789708605.121203:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789708605.121224:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686603a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.121231:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686603a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.121239:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686603a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708605.121251:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308529f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426250752:0@lo:101: 00000100:00100000:1.0:1789708605.121276:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708605.121312:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426250752 00000100:00100000:3.0:1789708605.121318:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426250752 00000100:00100000:1.0:1789708605.121320:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308387300 going to sleep for 11 seconds 00000100:00100000:3.0:1789708605.121358:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789708605.121366:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:5816:x1876645426250752:12345-0@lo:101: 00010000:00010000:3.0:1789708605.121375:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708605.121387:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa39400/0xa8f741d1c6866041 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c686603a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.121407:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa39400/0xa8f741d1c6866041 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c686603a expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.121418:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa39400/0xa8f741d1c6866041 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686603a expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.121426:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39400, rc 0) 00000100:00100000:3.0:1789708605.121468:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:5816:x1876645426250752:12345-0@lo:101: Request processed in 101us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708605.121476:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789708605.121479:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308529f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426250752:0@lo:101: 00010000:00010000:1.0:1789708605.121496:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686603a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866041 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.121528:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686603a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6866041 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708605.121568:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308529f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426250880:0@lo:501: 00000100:00100000:1.0:1789708605.121592:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708605.121610:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308387300 going to sleep for 11 seconds 00000100:00100000:3.0:1789708605.121628:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426250880 00000100:00100000:3.0:1789708605.121634:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426250880 00000100:00100000:3.0:1789708605.121684:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789708605.121691:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:5816:x1876645426250880:12345-0@lo:501: 00000100:00100000:3.0:1789708605.121886:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:5816:x1876645426250880:12345-0@lo:501: Request processed in 194us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708605.121906:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789708605.121910:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308529f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426250880:0@lo:501: 00000100:00100000:1.0:1789708605.121948:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308529f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426251008:0@lo:503: 00000100:00100000:1.0:1789708605.121983:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708605.122005:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308387300 going to sleep for 11 seconds 00000100:00100000:3.0:1789708605.122015:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426251008 00000100:00100000:3.0:1789708605.122020:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426251008 00000100:00100000:3.0:1789708605.122044:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789708605.122050:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:5816:x1876645426251008:12345-0@lo:503: 00000100:00100000:3.0:1789708605.122329:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:5816:x1876645426251008:12345-0@lo:503: Request processed in 278us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708605.122336:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789708605.122436:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308529f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426251008:0@lo:503: 00000100:00100000:3.0:1789708605.123538:0:7744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7744:1876645426251136:0@lo:502: 00000100:00100000:3.0:1789708605.123583:0:7744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708605.123616:0:7744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140363ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708605.123621:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426251136 00000100:00100000:1.0:1789708605.123627:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426251136 00000100:00100000:1.0:1789708605.123696:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789708605.123706:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:7744:x1876645426251136:12345-0@lo:502: 00000100:00100000:1.0:1789708605.123980:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:7744:x1876645426251136:12345-0@lo:502: Request processed in 277us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708605.123987:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789708605.124365:0:7744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7744:1876645426251136:0@lo:502: 00000020:01000000:3.0:1789708605.124391:0:7744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708605.124400:0:7744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708605.124402:0:7744:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789708605.124405:0:7744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789708605.124406:0:7744:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789708605.124419:0:7744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7744:1876645426251264:0@lo:502: 00000100:00100000:3.0:1789708605.124454:0:7744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708605.124479:0:7744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140363ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708605.124491:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426251264 00000100:00100000:1.0:1789708605.124496:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426251264 00000100:00100000:1.0:1789708605.124529:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789708605.124536:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:7744:x1876645426251264:12345-0@lo:502: 00000100:00100000:1.0:1789708605.124686:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:7744:x1876645426251264:12345-0@lo:502: Request processed in 150us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708605.124693:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789708605.124818:0:7744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7744:1876645426251264:0@lo:502: 00000020:01000000:3.0:1789708605.124837:0:7744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708605.124841:0:7744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708605.124843:0:7744:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789708605.124846:0:7744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1789708605.124920:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1789708605.124945:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789708605.124954:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686603a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866041 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.124966:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686603a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866041 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708605.124977:0:5816:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789708605.124979:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1410604800 from 30 10000000:01000000:1.0:1789708605.124982:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789708605.125002:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866048 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.125010:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866048 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.125019:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866048 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708605.125029:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308529f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426251392:0@lo:101: 00000100:00100000:1.0:1789708605.125053:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708605.125083:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426251392 00000100:00100000:3.0:1789708605.125088:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426251392 00000100:00100000:3.0:1789708605.125112:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789708605.125119:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:5816:x1876645426251392:12345-0@lo:101: 00010000:00010000:3.0:1789708605.125128:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789708605.125135:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308387480 going to sleep for 11 seconds 00010000:00010000:3.0:1789708605.125141:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa38400/0xa8f741d1c686604f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6866048 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.125162:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa38400/0xa8f741d1c686604f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6866048 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.125173:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa38400/0xa8f741d1c686604f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6866048 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.125234:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38400, rc 0) 00000100:00100000:3.0:1789708605.125271:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:5816:x1876645426251392:12345-0@lo:101: Request processed in 153us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708605.125275:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789708605.125323:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308529f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426251392:0@lo:101: 00010000:00010000:1.0:1789708605.125332:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866048 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686604f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708605.125340:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866048 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c686604f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708605.125388:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308529f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426251520:0@lo:501: 00000100:00100000:1.0:1789708605.125408:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708605.125445:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308387480 going to sleep for 11 seconds 00000100:00100000:3.0:1789708605.125466:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426251520 00000100:00100000:3.0:1789708605.125469:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426251520 00000100:00100000:3.0:1789708605.125516:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789708605.125523:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:5816:x1876645426251520:12345-0@lo:501: 00000100:00100000:3.0:1789708605.125722:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:5816:x1876645426251520:12345-0@lo:501: Request processed in 199us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708605.125729:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789708605.125853:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308529f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426251520:0@lo:501: 00000100:00100000:3.0:1789708605.125878:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426251648:0@lo:503: 00000100:00100000:3.0:1789708605.125916:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708605.125968:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140363c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789708605.126023:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426251648 00000100:00100000:1.0:1789708605.126026:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426251648 00000100:00100000:1.0:1789708605.126080:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789708605.126087:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:5816:x1876645426251648:12345-0@lo:503: 00000100:00100000:1.0:1789708605.126221:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:5816:x1876645426251648:12345-0@lo:503: Request processed in 134us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708605.126228:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789708605.126317:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426251648:0@lo:503: 00000100:00100000:3.0:1789708605.126457:0:7745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7745:1876645426251776:0@lo:502: 00000100:00100000:3.0:1789708605.126480:0:7745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708605.126493:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426251776 00000100:00100000:3.0:1789708605.126495:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426251776 00000100:00100000:3.0:1789708605.126577:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789708605.126584:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:7745:x1876645426251776:12345-0@lo:502: 00000100:00100000:3.0:1789708605.126755:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:7745:x1876645426251776:12345-0@lo:502: Request processed in 172us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708605.126760:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789708605.126783:0:7745:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140363c600 going to sleep for 11 seconds 00000100:00100000:3.0:1789708605.126791:0:7745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7745:1876645426251776:0@lo:502: 00000100:00100000:3.0:1789708605.126818:0:7745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7745:1876645426251904:0@lo:502: 00000100:00100000:3.0:1789708605.126851:0:7745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708605.126868:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426251904 00000100:00100000:3.0:1789708605.126870:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426251904 00000100:00100000:3.0:1789708605.126884:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789708605.126887:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:7745:x1876645426251904:12345-0@lo:502: 00000100:00100000:3.0:1789708605.126983:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:7745:x1876645426251904:12345-0@lo:502: Request processed in 94us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708605.126987:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789708605.127006:0:7745:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140363c600 going to sleep for 11 seconds 00000100:00100000:3.0:1789708605.127013:0:7745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7745:1876645426251904:0@lo:502: 00000040:00080000:3.0:1789708605.127026:0:7745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789708605.127055:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789708605.127066:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789708605.127072:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866048 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686604f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.127078:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686604f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708605.127083:0:5816:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789708605.127085:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1410604800 from 5 10000000:01000000:3.0:1789708605.127086:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789708605.127100:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa39a00/0xa8f741d1c6866056 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.127104:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143fa39a00/0xa8f741d1c6866056 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.127110:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143fa39a00/0xa8f741d1c6866056 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708605.127117:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426252032:0@lo:101: 00000100:00100000:3.0:1789708605.127134:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708605.127145:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140363c600 going to sleep for 11 seconds 00000100:00100000:3.0:1789708605.127159:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426252032 00000100:00100000:3.0:1789708605.127162:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426252032 00000100:00100000:3.0:1789708605.127294:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789708605.127300:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:5816:x1876645426252032:12345-0@lo:101: 00010000:00010000:3.0:1789708605.127305:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708605.127313:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa39800/0xa8f741d1c686605d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6866056 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.127325:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa39800/0xa8f741d1c686605d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6866056 expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.127330:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa39800/0xa8f741d1c686605d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6866056 expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.127336:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39800, rc 0) 00000100:00100000:3.0:1789708605.127355:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426252032:12345-0@lo:101: Request processed in 56us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708605.127359:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789708605.127424:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426252032:0@lo:101: 00010000:00010000:3.0:1789708605.127431:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143fa39a00/0xa8f741d1c6866056 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686605d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.127437:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143fa39a00/0xa8f741d1c6866056 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c686605d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708605.127467:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426252160:0@lo:256: 00000100:00100000:3.0:1789708605.127486:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708605.127582:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140363c600 going to sleep for 11 seconds 00000100:00100000:1.0:1789708605.127646:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426252160 00000100:00100000:1.0:1789708605.127751:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426252160 00000100:00100000:1.0:1789708605.127792:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789708605.127796:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426252160:12345-0@lo:256: 20000000:01000000:1.0:1789708605.127805:0:5812:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789708605.127818:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789708605.127821:0:5812:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789708605.127925:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426252160:12345-0@lo:256: Request processed in 127us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708605.127934:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789708605.127946:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426252160:0@lo:256: 10000000:01000000:2.0:1789708605.127994:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789708605.128000:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa39a00/0xa8f741d1c6866056 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686605d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708605.128009:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa39a00/0xa8f741d1c6866056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686605d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708605.128017:0:5816:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789708605.128019:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789708605.128021:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789708605.128038:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6866064 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708605.128046:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6866064 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708605.128054:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6866064 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708605.128066:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1410808700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426252288:0@lo:101: 00000100:00100000:2.0:1789708605.128094:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708605.128115:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426252288 00000100:00100000:2.0:1789708605.128122:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140766aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708605.128126:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426252288 00000100:00100000:3.0:1789708605.128154:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789708605.128158:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426252288:12345-0@lo:101: 00010000:00010000:3.0:1789708605.128164:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708605.128170:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa38c00/0xa8f741d1c686606b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6866064 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.128182:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa38c00/0xa8f741d1c686606b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6866064 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.128191:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa38c00/0xa8f741d1c686606b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6866064 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.128208:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38c00, rc 0) 00000100:00100000:3.0:1789708605.128239:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426252288:12345-0@lo:101: Request processed in 81us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708605.128243:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789708605.128280:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1410808700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426252288:0@lo:101: 00010000:00010000:2.0:1789708605.128291:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6866064 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686606b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708605.128298:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6866064 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c686606b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708605.128344:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1410808700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426252416:0@lo:501: 00000100:00100000:2.0:1789708605.128367:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708605.128386:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140766aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708605.128409:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426252416 00000100:00100000:1.0:1789708605.128415:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426252416 00000100:00100000:1.0:1789708605.128449:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789708605.128456:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426252416:12345-0@lo:501: 00000100:00100000:1.0:1789708605.128673:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426252416:12345-0@lo:501: Request processed in 218us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708605.128686:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789708605.128706:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1410808700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426252416:0@lo:501: 00000100:00100000:2.0:1789708605.128743:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1410808700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426252544:0@lo:503: 00000100:00100000:2.0:1789708605.128782:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708605.128810:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140766aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708605.128848:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426252544 00000100:00100000:3.0:1789708605.128852:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426252544 00000100:00100000:3.0:1789708605.128876:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789708605.128881:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426252544:12345-0@lo:503: 00000100:00100000:3.0:1789708605.129126:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426252544:12345-0@lo:503: Request processed in 244us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708605.129130:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789708605.129167:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1410808700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426252544:0@lo:503: 00000100:00100000:1.0:1789708605.129441:0:7746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7746:1876645426252672:0@lo:502: 00000100:00100000:1.0:1789708605.129473:0:7746:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708605.129497:0:7746:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13083873c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708605.129514:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426252672 00000100:00100000:0.0:1789708605.129520:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426252672 00000100:00100000:0.0:1789708605.129552:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789708605.129561:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:7746:x1876645426252672:12345-0@lo:502: 00000100:00100000:0.0:1789708605.129830:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:7746:x1876645426252672:12345-0@lo:502: Request processed in 271us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708605.129838:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789708605.129862:0:7746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7746:1876645426252672:0@lo:502: 00000020:01000000:1.0:1789708605.129884:0:7746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789708605.129890:0:7746:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789708605.129905:0:7746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708605.129908:0:7746:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789708605.129914:0:7746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789708605.129917:0:7746:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:01000000:1.0:1789708605.129936:0:7746:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789708605.129939:0:7746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789708605.129951:0:7746:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a14077019c0) 00000020:00000080:1.0:1789708605.129970:0:7746:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789708605.129976:0:7746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789708605.130044:0:7746:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789708605.130050:0:7746:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789708605.130056:0:7746:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa8f741d1c6866079 00010000:00080000:1.0:1789708605.130082:0:7746:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a14345ee000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:1.0:1789708605.130305:0:7746:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1789708605.130556:0:7746:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789708605.130566:0:7746:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789708605.131080:0:7746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708605.131226:0:7746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708605.131272:0:7746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789708605.131331:0:7746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789708605.131698:0:7747:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789708605.131702:0:7747:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789708605.132166:0:7746:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789708605.132179:0:7746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789708605.132209:0:7746:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789708605.132245:0:7746:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa8f741d1c6866080 00000100:00080000:3.0:1789708605.132256:0:7746:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789708605.132274:0:7746:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a14345ee000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1789708605.132307:0:7746:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a14037bb800 x1876645426252800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789708605.132342:0:7746:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789708605.132403:0:7746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708605.132408:0:7746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708605.132411:0:7746:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789708605.132414:0:7746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708605.132418:0:7746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708605.132419:0:7746:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000100:00100000:3.0:1789708605.132440:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876645426252928:0@lo:400: 00000100:00100000:3.0:1789708605.132511:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708605.132559:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426252928 00000100:00100000:0.0:1789708605.132568:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426252928 00000100:00100000:3.0:1789708605.132573:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876645426253184:0@lo:400: 00000100:00100000:3.0:1789708605.132605:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708605.132624:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426253184 00000100:00100000:3.0:1789708605.132629:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789708605.132629:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426253184 00000100:00100000:3.0:1789708605.132639:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e160700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426253056:0@lo:400: 00000100:00100000:0.0:1789708605.132684:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708605.132695:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876645426252928:12345-0@lo:400: 00000100:00100000:3.0:1789708605.132705:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708605.132731:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426253056 00000100:00100000:3.0:1789708605.132736:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426253056 00000100:00100000:3.0:1789708605.132758:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789708605.132764:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876645426253184:12345-0@lo:400: 00000100:00100000:1.0:1789708605.132835:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426252800:0@lo:8: 00010000:00080000:2.0:1789708605.132886:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143e161f80 x1876645426252928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708605.132909:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876645426252928:0@lo:400: 00000100:00100000:0.0:1789708605.133772:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876645426252928:12345-0@lo:400: Request processed in 1077us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708605.133780:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708605.133799:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789708605.133816:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426253056:12345-0@lo:400: 00000100:00100000:0.0:1789708605.133854:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426253056:12345-0@lo:400: Request processed in 42us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708605.133860:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1789708605.133877:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708605.134001:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876645426253184:12345-0@lo:400: Request processed in 1235us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708605.134012:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708605.134013:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789708605.134059:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143e160700 x1876645426253056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708605.134063:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426252800 00000100:00100000:2.0:1789708605.134070:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426252800 00000100:00100000:3.0:1789708605.134074:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e160700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426253056:0@lo:400: 00010000:00080000:3.0:1789708605.134097:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143e163800 x1876645426253184/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708605.134099:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789708605.134109:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3285:x1876645426252800:12345-0@lo:8: 00000100:00100000:3.0:1789708605.134113:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876645426253184:0@lo:400: 00000020:00000080:3.0:1789708605.134135:0:7746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00010000:00080000:2.0:1789708605.134136:0:6673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:3.0:1789708605.134139:0:7746:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789708605.134170:0:7746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7746:1876645426253312:0@lo:502: 00000020:00000080:2.0:1789708605.134173:0:6673:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa8f741d1c6866087 00002000:00100000:2.0:1789708605.134186:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a1306f82800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789708605.134191:0:6673:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1789708605.134195:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1789708605.134217:0:7746:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:2.0:1789708605.134300:0:6673:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789708605.134412:0:7746:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140363c9c0 going to sleep for 11 seconds 00002000:00080000:2.0:1789708605.134455:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789708605.134479:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8a1306f86000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789708605.134540:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1876645426252800:12345-0@lo:8: Request processed in 432us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708605.134547:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789708605.134594:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14037bb800 x1876645426252800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789708615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708605.134600:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789708605.134604:0:3285:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789708605.134610:0:3285:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789708605.134614:0:3285:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789708605.134616:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a14345ee000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789708605.134633:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789708605.134642:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426252800:0@lo:8: 00000100:00100000:0.0:1789708605.134683:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426253312 00000100:00100000:0.0:1789708605.134689:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426253312 00000100:00100000:0.0:1789708605.134728:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789708605.134736:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:7746:x1876645426253312:12345-0@lo:502: 00000004:00080000:3.0:1789708605.134798:0:7747:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789708605.134937:0:7747:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 170932286472ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789708605.135036:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:7746:x1876645426253312:12345-0@lo:502: Request processed in 300us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708605.135044:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789708605.135055:0:7746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:7746:1876645426253312:0@lo:502: 00000020:01000000:3.0:1789708605.135081:0:7746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708605.135087:0:7746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708605.135089:0:7746:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789708605.135093:0:7746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1789708605.135526:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789708605.135556:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789708605.135566:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6866064 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686606b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.135576:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6866064 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686606b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708605.135586:0:5816:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789708605.135589:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a1407ea19c0 from 1 10000000:01000000:0.0:1789708605.135592:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789708605.135617:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c686608e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.135626:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c686608e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.135645:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c686608e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708605.135680:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e161c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426253440:0@lo:101: 00000100:00100000:0.0:1789708605.135712:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708605.135744:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f905cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708605.135754:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426253440 00000100:00100000:3.0:1789708605.135760:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426253440 00000100:00100000:3.0:1789708605.135794:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789708605.135804:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426253440:12345-0@lo:101: 00010000:00010000:3.0:1789708605.135813:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708605.135825:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa39600/0xa8f741d1c6866095 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c686608e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.135845:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa39600/0xa8f741d1c6866095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c686608e expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.135855:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa39600/0xa8f741d1c6866095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686608e expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708605.135872:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39600, rc 0) 00000100:00100000:3.0:1789708605.135916:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426253440:12345-0@lo:101: Request processed in 114us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708605.135923:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789708605.136124:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e161c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426253440:0@lo:101: 00010000:00010000:0.0:1789708605.136142:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c686608e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866095 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.136151:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c686608e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6866095 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708605.136195:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e161c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426253568:0@lo:501: 00000100:00100000:0.0:1789708605.136223:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708605.136240:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f905cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708605.136253:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426253568 00000100:00100000:0.0:1789708605.136257:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426253568 00000100:00100000:0.0:1789708605.136282:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789708605.136288:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426253568:12345-0@lo:501: 00000100:00100000:0.0:1789708605.136457:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426253568:12345-0@lo:501: Request processed in 168us (232us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789708605.136463:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789708605.136494:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e161c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426253568:0@lo:501: 10000000:01000000:0.0:1789708605.136512:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789708605.136517:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c686608e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866095 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708605.136530:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c686608e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866095 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789708605.154847:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789708605.154885:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789708605.154916:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426253696:0@lo:13: 00000100:00100000:0.0:1789708605.154984:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789708605.155025:0:7748:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789708605.155039:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426253696 00000100:00100000:2.0:1789708605.155048:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426253696 00000100:00100000:0.0:1789708605.155049:0:7748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e160e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7748:1876645426253824:0@lo:7: 00000100:00100000:0.0:1789708605.155078:0:7748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708605.155101:0:7748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f905180 going to sleep for 11 seconds 00000100:00080000:1.0:1789708605.155111:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789708605.155127:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426253824 00000100:00100000:2.0:1789708605.155132:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708605.155133:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426253824 00000100:00100000:2.0:1789708605.155148:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e162680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1876645426253696:12345-0@lo:13: 00000100:00100000:3.0:1789708605.155172:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00002000:00000024:2.0:1789708605.155172:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:3.0:1789708605.155184:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7748:x1876645426253824:12345-0@lo:7: 00000100:00100000:2.0:1789708605.155315:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e162680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1876645426253696:12345-0@lo:13: Request processed in 170us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708605.155322:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789708605.155365:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143e161c00 x1876645426253696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708605.155382:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426253696:0@lo:13: 00002000:00080000:0.0:1789708605.164371:0:6672:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789708605.164379:0:6672:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789708605.166887:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7748:x1876645426253824:12345-0@lo:7: Request processed in 11699us (11800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708605.166915:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789708605.167601:0:7748:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143e160e00 x1876645426253824/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789708621 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708605.167617:0:7748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e160e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7748:1876645426253824:0@lo:7: 00000004:00080000:2.0:1789708605.167633:0:7748:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789708605.167699:0:7748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1410808700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7748:1876645426253952:0@lo:5: 00000100:00100000:2.0:1789708605.167747:0:7748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708605.167792:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426253952 00000100:00100000:2.0:1789708605.167795:0:7748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140766aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708605.167800:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426253952 00000100:00100000:0.0:1789708605.167968:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789708605.167978:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7748:x1876645426253952:12345-0@lo:5: 00002000:00080000:0.0:1789708605.168015:0:6673:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789708605.168020:0:6673:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789708605.168312:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7748:x1876645426253952:12345-0@lo:5: Request processed in 336us (564us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789708605.168328:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789708605.168358:0:7748:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1410808700 x1876645426253952/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789708621 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708605.168371:0:7748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1410808700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7748:1876645426253952:0@lo:5: 00000004:00080000:2.0:1789708605.168379:0:7748:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789708605.168410:0:7748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7748:1876645426254080:0@lo:700: 00000100:00100000:2.0:1789708605.168434:0:7748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708605.168456:0:7748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140766aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708605.168489:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426254080 00000100:00100000:1.0:1789708605.168499:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426254080 00000100:00100000:1.0:1789708605.168532:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708605.168539:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410809c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7748:x1876645426254080:12345-0@lo:700: 00000100:00100000:1.0:1789708605.168575:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308529c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6680:1876645426254208:0@lo:700: 00000100:00100000:1.0:1789708605.168604:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708605.168625:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308387540 going to sleep for 11 seconds 00000100:00100000:0.0:1789708605.168700:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426254208 00000100:00100000:0.0:1789708605.168705:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426254208 00000100:00100000:0.0:1789708605.168735:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708605.168744:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:6680:x1876645426254208:12345-0@lo:700: 40000000:02000000:0.0:1789708605.202205:0:5827:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1789708605.205787:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:6680:x1876645426254208:12345-0@lo:700: Request processed in 37036us (37173us total) trans 0 rc 0/0 00010000:00080000:3.0:1789708605.205809:0:6680:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1308529c00 x1876645426254208/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789708621 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708605.205819:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789708605.205831:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308529c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6680:1876645426254208:0@lo:700: 40000000:02000000:3.0:1789708605.205846:0:6680:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1789708605.243409:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1789708605.243432:0:7627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789708605.243599:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410809c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7748:x1876645426254080:12345-0@lo:700: Request processed in 75056us (75159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708605.243612:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789708605.243636:0:7748:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a141080b100 x1876645426254080/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789708621 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708605.243647:0:7748:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789708605.243828:0:7748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7748:1876645426254080:0@lo:700: 00000004:02000040:2.0:1789708605.260986:0:7748:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1789708605.265872:0:7748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7748:1876645426254336:0@lo:5: 00000100:00100000:3.0:1789708605.265965:0:7748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708605.266038:0:7748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1407e23b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708605.266141:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426254336 00000100:00100000:2.0:1789708605.266152:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426254336 00000100:00100000:2.0:1789708605.266215:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789708605.266226:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7748:x1876645426254336:12345-0@lo:5: 00002000:00080000:2.0:1789708605.271373:0:6672:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789708605.271395:0:6672:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1789708605.274772:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7748:x1876645426254336:12345-0@lo:5: Request processed in 8542us (8802us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789708605.274786:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789708605.278114:0:7748:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14037b8e00 x1876645426254336/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789708621 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708605.278134:0:7748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7748:1876645426254336:0@lo:5: 00000004:00080000:0.0:1789708605.278150:0:7748:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1789708605.563153:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708606.586740:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789708606.871720:0:7971:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789708607.611162:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708608.634813:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708609.658795:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708609.788816:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789708609.788910:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426254464:0@lo:13: 00000100:00100000:1.0:1789708609.788987:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708609.790194:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426254464 00000100:00100000:0.0:1789708609.790203:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426254464 00000100:00100000:2.0:1789708609.790305:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789708609.790314:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130852a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426254464:12345-0@lo:13: 00002000:00000024:2.0:1789708609.790348:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789708609.790401:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130852a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426254464:12345-0@lo:13: Request processed in 88us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708609.790407:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789708609.790447:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14037bbb80 x1876645426254464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708609.790465:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426254464:0@lo:13: 00000100:00080000:0.0:1789708609.790539:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789708610.086053:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1789708610.300867:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426254592:0@lo:13: 00000100:00100000:0.0:1789708610.300939:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708610.301337:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876645426254976:0@lo:400: 00000100:00100000:0.0:1789708610.301373:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708610.301395:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789708610.301401:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130852bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876645426254848:0@lo:400: 00000100:00100000:0.0:1789708610.301423:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708610.301449:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426254976 00000100:00100000:0.0:1789708610.301458:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426254976 00000100:00100000:0.0:1789708610.301505:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426254848 00000100:00100000:0.0:1789708610.301508:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426254848 00000100:00100000:0.0:1789708610.301548:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708610.301557:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876645426254976:12345-0@lo:400: 00000100:00100000:0.0:1789708610.301607:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876645426254976:12345-0@lo:400: Request processed in 52us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708610.301615:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708610.301631:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789708610.301640:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876645426254848:12345-0@lo:400: 00000100:00100000:0.0:1789708610.301687:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876645426254848:12345-0@lo:400: Request processed in 48us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708610.301693:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789708610.301712:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708610.301729:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426254720:0@lo:400: 00000100:00100000:0.0:1789708610.301758:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708610.301783:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130852b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876645426255232:0@lo:400: 00000100:00100000:0.0:1789708610.301807:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708610.301824:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789708610.301830:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130852aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426255104:0@lo:400: 00000100:00100000:0.0:1789708610.301868:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708610.301894:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426254720 00000100:00100000:0.0:1789708610.301899:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426254720 00000100:00100000:0.0:1789708610.301925:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789708610.301933:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3287:x1876645426254720:12345-0@lo:400: 00000100:00100000:0.0:1789708610.301968:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3287:x1876645426254720:12345-0@lo:400: Request processed in 35us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708610.301974:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789708610.301999:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426255104 00000100:00100000:0.0:1789708610.302009:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426255104 00000100:00100000:0.0:1789708610.302036:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708610.302043:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426255104:12345-0@lo:400: 00000100:00100000:0.0:1789708610.302073:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426255104:12345-0@lo:400: Request processed in 31us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708610.302079:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789708610.302117:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a130852bb80 x1876645426254848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708610.302131:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130852bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876645426254848:0@lo:400: 00010000:00080000:0.0:1789708610.302141:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1308528700 x1876645426254976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708610.302149:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876645426254976:0@lo:400: 00010000:00080000:0.0:1789708610.302176:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a130852aa00 x1876645426255104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708610.302184:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130852aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426255104:0@lo:400: 00000100:00100000:0.0:1789708610.302192:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426254720:0@lo:400: 00000100:00100000:0.0:1789708610.302211:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426255232 00000100:00100000:0.0:1789708610.302215:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426255232 00000100:00100000:0.0:1789708610.302243:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789708610.302250:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876645426255232:12345-0@lo:400: 00000100:00100000:0.0:1789708610.302280:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876645426255232:12345-0@lo:400: Request processed in 31us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708610.302286:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789708610.302300:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789708610.302314:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a130852b800 x1876645426255232/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708610.302329:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130852b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876645426255232:0@lo:400: 00000100:00100000:2.0:1789708610.303467:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426254592 00000100:00100000:2.0:1789708610.303476:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426254592 00000100:00100000:2.0:1789708610.303519:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789708610.303527:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426254592:12345-0@lo:13: 00002000:00000024:2.0:1789708610.303556:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789708610.303605:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426254592:12345-0@lo:13: Request processed in 79us (2666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708610.303612:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789708610.303782:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789708610.303807:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143e161c00 x1876645426254592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708626 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708610.303816:0:3286:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789708610.303833:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426254592:0@lo:13: 00010000:00010000:1.0:1789708610.683041:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708611.387877:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708611.388010:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415747968 00000100:00100000:2.0:1789708611.388019:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415747968 00000100:00100000:2.0:1789708611.388053:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 108 00000100:00100000:2.0:1789708611.388060:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2360:x1876645415747968:12345-192.168.202.53@tcp:250: 00010000:00080000:2.0:1789708611.388090:0:5812:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 7afaea2d-d635-45b7-851c-2e40ec565b3d@192.168.202.53@tcp t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:2.0:1789708611.388113:0:5812:0:(genops.c:1384:class_connect()) connect: client 7afaea2d-d635-45b7-851c-2e40ec565b3d, cookie 0xa8f741d1c686609c 00000100:00080000:2.0:1789708611.388248:0:5812:0:(import.c:65:import_set_state_nolock()) ffff8a143f2e7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789708611.388312:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+5:2360:x1876645415747968:12345-192.168.202.53@tcp:250: Request processed in 251us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708611.388319:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 108 00000100:00100000:2.0:1789708611.391742:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708611.391920:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415747840 00000100:00100000:0.0:1789708611.391932:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415747840 00000100:00100000:0.0:1789708611.392043:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 109 00000100:00100000:0.0:1789708611.392055:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+5:5580:x1876645415747840:12345-192.168.202.53@tcp:101: 00010000:00010000:0.0:1789708611.392080:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708611.392097:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400031400/0xa8f741d1c68660a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d46e2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708611.392124:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400031400/0xa8f741d1c68660a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d46e2 expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708611.392135:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400031400/0xa8f741d1c68660a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d46e2 expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708611.392145:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400031400, rc 0) 00000100:00100000:0.0:1789708611.392201:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+6:5580:x1876645415747840:12345-192.168.202.53@tcp:101: Request processed in 149us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708611.392208:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 109 00000100:00100000:3.0:1789708611.397020:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708611.397190:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415748096 00000100:00100000:0.0:1789708611.397200:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415748096 00000100:00100000:0.0:1789708611.397263:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 110 00000100:00100000:0.0:1789708611.397274:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+6:5580:x1876645415748096:12345-192.168.202.53@tcp:501: 00000100:00100000:0.0:1789708611.397718:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+6:5580:x1876645415748096:12345-192.168.202.53@tcp:501: Request processed in 444us (705us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789708611.397737:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 110 00000100:00100000:1.0:1789708611.400562:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708611.400682:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415748224 00000100:00100000:0.0:1789708611.400692:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415748224 00000100:00100000:0.0:1789708611.400858:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 111 00000100:00100000:0.0:1789708611.400869:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+6:5580:x1876645415748224:12345-192.168.202.53@tcp:101: 00010000:00010000:0.0:1789708611.400885:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708611.400903:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400031200/0xa8f741d1c68660aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d46e9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708611.400929:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400031200/0xa8f741d1c68660aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d46e9 expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708611.400939:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400031200/0xa8f741d1c68660aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d46e9 expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708611.400949:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400031200, rc 0) 00000100:00100000:0.0:1789708611.401007:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+7:5580:x1876645415748224:12345-192.168.202.53@tcp:101: Request processed in 141us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708611.401015:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 111 00000100:00100000:2.0:1789708611.402808:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708611.402886:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415748352 00000100:00100000:3.0:1789708611.402895:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415748352 00000100:00100000:3.0:1789708611.402944:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 112 00000100:00100000:3.0:1789708611.402953:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+7:5580:x1876645415748352:12345-192.168.202.53@tcp:501: 00000100:00100000:3.0:1789708611.403285:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+8:5580:x1876645415748352:12345-192.168.202.53@tcp:501: Request processed in 332us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708611.403293:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 112 00000100:00100000:2.0:1789708611.405626:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708611.405742:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415748480 00000100:00100000:0.0:1789708611.405750:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415748480 00000100:00100000:0.0:1789708611.405901:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 113 00000100:00100000:0.0:1789708611.405912:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+8:5580:x1876645415748480:12345-192.168.202.53@tcp:503: 00000100:00100000:0.0:1789708611.406513:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+8:5580:x1876645415748480:12345-192.168.202.53@tcp:503: Request processed in 602us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708611.406522:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 113 00000100:00100000:1.0:1789708611.409292:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708611.409459:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415748608 00000100:00100000:0.0:1789708611.409478:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415748608 00000100:00100000:0.0:1789708611.409571:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 114 00000100:00100000:0.0:1789708611.409582:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+8:5598:x1876645415748608:12345-192.168.202.53@tcp:502: 00000100:00100000:0.0:1789708611.409961:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+8:5598:x1876645415748608:12345-192.168.202.53@tcp:502: Request processed in 380us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708611.409969:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 114 00000100:00100000:2.0:1789708611.441085:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708611.441192:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415748736 00000100:00100000:0.0:1789708611.441202:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415748736 00000100:00100000:0.0:1789708611.441263:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 115 00000100:00100000:0.0:1789708611.441275:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+8:5598:x1876645415748736:12345-192.168.202.53@tcp:502: 00000100:00100000:0.0:1789708611.441562:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+8:5598:x1876645415748736:12345-192.168.202.53@tcp:502: Request processed in 290us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708611.441570:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 115 00000100:00100000:2.0:1789708611.446210:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708611.446517:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415748864 00000100:00100000:0.0:1789708611.446527:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415748864 00000100:00100000:0.0:1789708611.446591:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 116 00000100:00100000:0.0:1789708611.446601:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+8:5580:x1876645415748864:12345-192.168.202.53@tcp:101: 00010000:00010000:0.0:1789708611.446618:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708611.446637:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400030e00/0xa8f741d1c68660b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4713 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708611.446701:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400030e00/0xa8f741d1c68660b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4713 expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708611.446712:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400030e00/0xa8f741d1c68660b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4713 expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708611.446720:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400030e00, rc 0) 00000100:00100000:0.0:1789708611.446938:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:5580:x1876645415748864:12345-192.168.202.53@tcp:101: Request processed in 338us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708611.446945:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 116 00000100:00100000:1.0:1789708611.456791:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708611.456954:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415748992 00000100:00100000:3.0:1789708611.456964:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415748992 00000100:00100000:3.0:1789708611.457025:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 117 00000100:00100000:3.0:1789708611.457036:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:5580:x1876645415748992:12345-192.168.202.53@tcp:256: 20000000:01000000:3.0:1789708611.457061:0:5812:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789708611.457098:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789708611.457103:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789708611.457106:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789708611.457108:0:5812:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1789708611.458744:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:5580:x1876645415748992:12345-192.168.202.53@tcp:256: Request processed in 1703us (1962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708611.458884:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 117 00000100:00100000:0.0:1789708611.461742:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708611.461930:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415749120 00000100:00100000:3.0:1789708611.461941:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415749120 00000100:00100000:3.0:1789708611.461996:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 118 00000100:00100000:3.0:1789708611.462005:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:5580:x1876645415749120:12345-192.168.202.53@tcp:101: 00010000:00010000:3.0:1789708611.462021:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708611.462038:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa38600/0xa8f741d1c68660b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d471a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708611.462065:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa38600/0xa8f741d1c68660b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d471a expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708611.462075:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa38600/0xa8f741d1c68660b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d471a expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708611.462097:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38600, rc 0) 00000100:00100000:3.0:1789708611.462222:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:5580:x1876645415749120:12345-192.168.202.53@tcp:101: Request processed in 217us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708611.462229:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 118 00000100:00100000:1.0:1789708611.464036:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708611.464113:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415749248 00000100:00100000:3.0:1789708611.464120:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415749248 00000100:00100000:3.0:1789708611.464231:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 119 00000100:00100000:3.0:1789708611.464241:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:5580:x1876645415749248:12345-192.168.202.53@tcp:501: 00000100:00100000:3.0:1789708611.464518:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:5580:x1876645415749248:12345-192.168.202.53@tcp:501: Request processed in 278us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708611.464526:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 119 00000100:00100000:0.0:1789708611.465950:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708611.466044:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415749376 00000100:00100000:2.0:1789708611.466051:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415749376 00000100:00100000:2.0:1789708611.466135:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 120 00000100:00100000:2.0:1789708611.466145:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:5580:x1876645415749376:12345-192.168.202.53@tcp:503: 00000100:00100000:2.0:1789708611.466507:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:5580:x1876645415749376:12345-192.168.202.53@tcp:503: Request processed in 362us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708611.466514:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 120 00000100:00100000:2.0:1789708611.469719:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708611.469800:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415749504 00000100:00100000:0.0:1789708611.469809:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415749504 00000100:00100000:0.0:1789708611.469880:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 121 00000100:00100000:0.0:1789708611.469891:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:5603:x1876645415749504:12345-192.168.202.53@tcp:502: 00000100:00100000:0.0:1789708611.470256:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:5603:x1876645415749504:12345-192.168.202.53@tcp:502: Request processed in 366us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708611.470264:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 121 00000100:00100000:1.0:1789708611.472474:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708611.472563:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415749632 00000100:00100000:2.0:1789708611.472571:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415749632 00000100:00100000:2.0:1789708611.472642:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 122 00000100:00100000:2.0:1789708611.472679:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:5603:x1876645415749632:12345-192.168.202.53@tcp:502: 00000100:00100000:2.0:1789708611.472936:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:5603:x1876645415749632:12345-192.168.202.53@tcp:502: Request processed in 286us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708611.472943:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 122 00000100:00100000:0.0:1789708611.476385:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708611.476687:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415749760 00000100:00100000:3.0:1789708611.476697:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415749760 00000100:00100000:3.0:1789708611.476737:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:3.0:1789708611.476745:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1876645415749760:12345-192.168.202.53@tcp:38: 00010000:00080000:3.0:1789708611.476774:0:5821:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:3.0:1789708611.476820:0:5821:0:(genops.c:1384:class_connect()) connect: client 14bb7f14-3461-47f6-86c9-db3f545050ad, cookie 0xa8f741d1c68660bf 00000004:00100000:3.0:1789708611.476857:0:5821:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789708611.476864:0:5821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1789708611.499982:0:5821:0:(import.c:65:import_set_state_nolock()) ffff8a14076be000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708611.500068:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2360:x1876645415749760:12345-192.168.202.53@tcp:38: Request processed in 23321us (23690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708611.500082:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00010000:00010000:3.0:1789708611.706864:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708612.503753:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708612.503864:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708612.505705:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415749888 00000100:00100000:2.0:1789708612.505718:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415749888 00000100:00100000:2.0:1789708612.505802:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415750016 00000100:00100000:2.0:1789708612.505806:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415750016 00000100:00100000:2.0:1789708612.505844:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:2.0:1789708612.505855:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+7:0:x1876645415749888:12345-192.168.202.53@tcp:41: 00000004:00000024:2.0:1789708612.505900:0:7140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789708612.505969:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+7:0:x1876645415749888:12345-192.168.202.53@tcp:41: Request processed in 115us (2225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708612.505977:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:2.0:1789708612.505995:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:2.0:1789708612.506018:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+6:5580:x1876645415750016:12345-192.168.202.53@tcp:41: 00000004:00000024:2.0:1789708612.506030:0:7140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789708612.506051:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+6:5580:x1876645415750016:12345-192.168.202.53@tcp:41: Request processed in 35us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708612.506058:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00080000:0.0:1789708612.506139:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708612.510805:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708612.511441:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415750144 00000100:00100000:1.0:1789708612.511453:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415750144 00000100:00100000:2.0:1789708612.511560:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:2.0:1789708612.511575:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+6:5580:x1876645415750144:12345-192.168.202.53@tcp:40: 00000100:00100000:2.0:1789708612.511790:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+6:5580:x1876645415750144:12345-192.168.202.53@tcp:40: Request processed in 219us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708612.511799:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:0.0:1789708612.520840:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708612.520903:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708612.520928:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708612.521086:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708612.521118:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415750656 00000100:00100000:0.0:1789708612.521126:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415750656 00000100:00100000:0.0:1789708612.521187:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 123 00000100:00100000:0.0:1789708612.521197:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2363:x1876645415750656:12345-192.168.202.53@tcp:400: 00000100:00100000:0.0:1789708612.521267:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2363:x1876645415750656:12345-192.168.202.53@tcp:400: Request processed in 72us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708612.521274:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 123 00000100:00100000:1.0:1789708612.522895:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415750528 00000100:00100000:1.0:1789708612.522906:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415750528 00000100:00100000:1.0:1789708612.522962:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:1.0:1789708612.522972:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+6:5580:x1876645415750528:12345-192.168.202.53@tcp:33: 00000100:00100000:3.0:1789708612.526619:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415750272 00000100:00100000:3.0:1789708612.526643:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415750272 00000100:00100000:3.0:1789708612.526701:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415750400 00000100:00100000:3.0:1789708612.526705:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415750400 00000100:00100000:3.0:1789708612.526722:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:3.0:1789708612.526729:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1876645415750272:12345-192.168.202.53@tcp:8: 00010000:00080000:3.0:1789708612.526769:0:6673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:3.0:1789708612.526796:0:6673:0:(genops.c:1384:class_connect()) connect: client 14bb7f14-3461-47f6-86c9-db3f545050ad, cookie 0xa8f741d1c68660c6 00002000:00100000:3.0:1789708612.526806:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 14bb7f14-3461-47f6-86c9-db3f545050ad/ffff8a140318c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789708612.526840:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789708612.527159:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789708612.527193:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8a140318f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708612.527282:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2360:x1876645415750272:12345-192.168.202.53@tcp:8: Request processed in 552us (6461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708612.527291:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:3.0:1789708612.527308:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:3.0:1789708612.527313:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1876645415750400:12345-192.168.202.53@tcp:8: 00010000:00080000:3.0:1789708612.527329:0:6673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:3.0:1789708612.527350:0:6673:0:(genops.c:1384:class_connect()) connect: client 14bb7f14-3461-47f6-86c9-db3f545050ad, cookie 0xa8f741d1c68660cd 00002000:00100000:3.0:1789708612.527355:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 14bb7f14-3461-47f6-86c9-db3f545050ad/ffff8a1403189800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789708612.527370:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789708612.530510:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789708612.530555:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8a140318c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708612.537763:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2360:x1876645415750400:12345-192.168.202.53@tcp:8: Request processed in 10434us (16820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708612.537780:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000004:00080000:2.0:1789708612.539720:0:5822:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 16640us 00000004:00200000:1.0:1789708612.570791:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789708612.570903:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+6:5580:x1876645415750528:12345-192.168.202.53@tcp:33: Request processed in 47927us (49995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708612.570915:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:0.0:1789708612.698247:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708612.698379:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415750784 00000100:00100000:3.0:1789708612.698390:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415750784 00000100:00100000:3.0:1789708612.698453:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:3.0:1789708612.698464:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:5620:x1876645415750784:12345-192.168.202.53@tcp:101: 00010000:00010000:3.0:1789708612.698500:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708612.698526:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38a00/0xa8f741d1c68660d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4744 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708612.698593:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68660db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708612.698607:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68660db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708612.698621:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68660db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708612.698686:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789708612.698691:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789708612.698708:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68660db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708612.698733:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38a00/0xa8f741d1c68660d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4744 expref: 8 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708612.698750:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68660db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4744 expref: 7 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708612.698759:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:3.0:1789708612.698762:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789708612.698766:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39e00, rc 0) 00000100:00100000:3.0:1789708612.698832:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+7:5620:x1876645415750784:12345-192.168.202.53@tcp:101: Request processed in 370us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708612.698840:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00010000:00010000:1.0:1789708612.730854:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708613.755150:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708614.490720:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708614.490798:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415750912 00000100:00100000:1.0:1789708614.490819:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415750912 00000100:00100000:1.0:1789708614.490903:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:1.0:1789708614.490914:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+7:5672:x1876645415750912:12345-192.168.202.53@tcp:41: 00000004:00000024:1.0:1789708614.490957:0:5819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789708614.491041:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+7:5672:x1876645415750912:12345-192.168.202.53@tcp:41: Request processed in 129us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708614.491050:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00080000:0.0:1789708614.491191:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708614.493745:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708614.493861:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415751040 00000100:00100000:2.0:1789708614.493871:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415751040 00000100:00100000:2.0:1789708614.493942:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:2.0:1789708614.493955:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14bb7f14-3461-47f6-86c9-db3f545050ad+6:5672:x1876645415751040:12345-192.168.202.53@tcp:13: 00002000:00000024:2.0:1789708614.493991:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789708614.494051:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14bb7f14-3461-47f6-86c9-db3f545050ad+6:5672:x1876645415751040:12345-192.168.202.53@tcp:13: Request processed in 99us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708614.494060:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00080000:0.0:1789708614.494113:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708614.495513:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708614.495854:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415751168 00000100:00100000:2.0:1789708614.495862:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415751168 00000100:00100000:2.0:1789708614.495915:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:2.0:1789708614.495925:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14bb7f14-3461-47f6-86c9-db3f545050ad+6:5672:x1876645415751168:12345-192.168.202.53@tcp:13: 00002000:00000024:2.0:1789708614.495955:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789708614.496079:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708614.496109:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:14bb7f14-3461-47f6-86c9-db3f545050ad+6:5672:x1876645415751168:12345-192.168.202.53@tcp:13: Request processed in 186us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708614.496138:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00010000:00010000:1.0:1789708614.778787:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708614.907122:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789708614.907142:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426255360:0@lo:13: 00000100:00100000:0.0:1789708614.907203:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708614.907255:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426255360 00000100:00100000:3.0:1789708614.907264:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426255360 00000100:00080000:0.0:1789708614.907357:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708614.907399:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789708614.907411:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426255360:12345-0@lo:13: 00002000:00000024:3.0:1789708614.907435:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708614.907871:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426255360:12345-0@lo:13: Request processed in 462us (667us total) trans 0 rc 0/0 00010000:00080000:0.0:1789708614.907876:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14037ba680 x1876645426255360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708630 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708614.907882:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708614.907917:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426255360:0@lo:13: 00000100:00100000:2.0:1789708615.418957:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426255488:0@lo:400: 00000100:00100000:1.0:1789708615.418994:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130852b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426255744:0@lo:400: 00000100:00100000:2.0:1789708615.419037:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708615.419049:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708615.419080:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130852b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426255872:0@lo:400: 00000100:00100000:1.0:1789708615.419098:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789708615.419107:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426256000:0@lo:400: 00000100:00100000:1.0:1789708615.419109:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130852a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876645426255616:0@lo:400: 00000100:00100000:3.0:1789708615.419120:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708615.419166:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708615.419180:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426255872 00000100:00100000:3.0:1789708615.419190:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426255872 00000100:00100000:1.0:1789708615.419194:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426255488 00000100:00100000:1.0:1789708615.419200:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426255488 00000100:00100000:2.0:1789708615.419228:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426255744 00000100:00100000:2.0:1789708615.419234:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426255744 00000100:00100000:3.0:1789708615.419247:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708615.419258:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426255872:12345-0@lo:400: 00000100:00100000:2.0:1789708615.419278:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426256000 00000100:00100000:2.0:1789708615.419282:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426256000 00000100:00100000:2.0:1789708615.419319:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789708615.419320:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426255872:12345-0@lo:400: Request processed in 60us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708615.419329:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426255744:12345-0@lo:400: 00000100:00100000:3.0:1789708615.419332:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789708615.419377:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426255744:12345-0@lo:400: Request processed in 50us (328us total) trans 0 rc 0/0 00010000:00080000:3.0:1789708615.419383:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a130852b800 x1876645426255872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708615.419388:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789708615.419404:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130852b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426255872:0@lo:400: 00000100:00100000:1.0:1789708615.419408:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789708615.419420:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426255488:12345-0@lo:400: 00000100:00100000:2.0:1789708615.419426:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789708615.419436:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a141080b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426256000:12345-0@lo:400: 00000100:00100000:1.0:1789708615.419478:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426255488:12345-0@lo:400: Request processed in 60us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708615.419482:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a141080b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426256000:12345-0@lo:400: Request processed in 46us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708615.419490:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789708615.419495:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789708615.419535:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1789708615.419546:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708615.419547:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426256256:0@lo:13: 00000100:00100000:1.0:1789708615.419556:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708615.419576:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130852aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426256128:0@lo:400: 00000100:00100000:0.0:1789708615.419579:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708615.419594:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708615.419618:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130852b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426255744:0@lo:400: 00000100:00100000:1.0:1789708615.419644:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426256256 00000100:00100000:1.0:1789708615.419665:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426256256 00000100:00100000:1.0:1789708615.419691:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789708615.419697:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426256256:12345-0@lo:13: 00002000:00000024:1.0:1789708615.419710:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708615.419842:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426256256:12345-0@lo:13: Request processed in 145us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708615.419848:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789708615.419876:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143fb29180 x1876645426256256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708631 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708615.419890:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426256256:0@lo:13: 00000100:00100000:2.0:1789708615.419933:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426255616 00000100:00100000:2.0:1789708615.419939:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426255616 00000100:00100000:2.0:1789708615.419975:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789708615.419982:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130852bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876645426255616:12345-0@lo:400: 00000100:00100000:3.0:1789708615.420007:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426256128 00000100:00100000:3.0:1789708615.420012:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426256128 00000100:00100000:2.0:1789708615.420026:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130852bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876645426255616:12345-0@lo:400: Request processed in 44us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708615.420045:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789708615.420046:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789708615.420049:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130852a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876645426255616:0@lo:400: 00000100:00100000:3.0:1789708615.420060:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426256128:12345-0@lo:400: 00000100:00080000:2.0:1789708615.420076:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708615.420104:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426256000:0@lo:400: 00000100:00100000:1.0:1789708615.420119:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426255488:0@lo:400: 00000100:00100000:3.0:1789708615.420125:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426256128:12345-0@lo:400: Request processed in 68us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708615.420135:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789708615.420165:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a130852aa00 x1876645426256128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708615.420176:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130852aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426256128:0@lo:400: 00010000:00010000:3.0:1789708615.802821:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789708615.949889:0:8277:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1789708615.949981:0:7627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14bb7f14-3461-47f6-86c9-db3f545050ad 00000001:00100000:0.0:1789708616.467808:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 14bb7f14-3461-47f6-86c9-db3f545050ad 00010000:00010000:2.0:1789708616.834143:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789708616.978178:0:5841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 14bb7f14-3461-47f6-86c9-db3f545050ad 00010000:00010000:0.0:1789708617.850917:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708617.978692:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708617.978723:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708617.978743:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708617.978761:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708617.978795:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415751680 00000100:00100000:2.0:1789708617.978803:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415751680 00000100:00100000:2.0:1789708617.978848:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415751552 00000100:00100000:2.0:1789708617.978850:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415751552 00000100:00100000:0.0:1789708617.978855:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415751424 00000100:00100000:0.0:1789708617.978862:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415751424 00000100:00100000:2.0:1789708617.978865:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:2.0:1789708617.978875:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410808e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2363:x1876645415751680:12345-192.168.202.53@tcp:400: 00000100:00100000:0.0:1789708617.978909:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:0.0:1789708617.978925:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2363:x1876645415751424:12345-192.168.202.53@tcp:400: 00000100:00100000:2.0:1789708617.978937:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410808e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2363:x1876645415751680:12345-192.168.202.53@tcp:400: Request processed in 64us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708617.978964:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2363:x1876645415751424:12345-192.168.202.53@tcp:400: Request processed in 45us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708617.978978:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:2.0:1789708617.979591:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:2.0:1789708617.979608:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:2.0:1789708617.979617:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a141080ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2363:x1876645415751552:12345-192.168.202.53@tcp:400: 00000100:00100000:2.0:1789708617.979671:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a141080ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2363:x1876645415751552:12345-192.168.202.53@tcp:400: Request processed in 36us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708617.979678:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:2.0:1789708617.979697:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415751296 00000100:00100000:2.0:1789708617.979702:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415751296 00000100:00100000:2.0:1789708617.979729:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 125 00000100:00100000:2.0:1789708617.979734:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2363:x1876645415751296:12345-192.168.202.53@tcp:400: 00000100:00100000:2.0:1789708617.979754:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2363:x1876645415751296:12345-192.168.202.53@tcp:400: Request processed in 20us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708617.979765:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 125 00000100:00080000:2.0:1789708617.979836:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789708617.979841:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789708617.979844:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:1.0:1789708618.029479:0:8428:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd06c23600 20000000:00000080:1.0:1789708618.029495:0:8428:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a1308227400 uarg=0000000000000000 20000000:01000000:1.0:1789708618.029530:0:8428:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789708618.029532:0:8428:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789708618.029535:0:8428:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789708618.029540:0:8428:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789708618.029544:0:8428:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789708618.029557:0:8428:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789708618.029559:0:8428:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789708618.029803:0:8428:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789708618.029806:0:8428:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789708618.030382:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1789708618.030899:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1789708618.030949:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1789708618.030984:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1789708618.031000:0:8428:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789708618.031002:0:8428:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789708618.031633:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1789708618.032067:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1789708618.032110:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1789708618.032160:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1789708618.032177:0:8428:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789708618.032179:0:8428:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789708618.033046:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789708618.033410:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789708618.033455:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1789708618.033481:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1789708618.033500:0:8428:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789708618.033502:0:8428:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789708618.034252:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1789708618.034557:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1789708618.034612:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1789708618.034815:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1789708618.034836:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789708618.034856:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a14013a0000/0xa8f741d1c68660e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.034873:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1401691400/0xa8f741d1c6865fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865fd8 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.034881:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1401691200/0xa8f741d1c6866009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6866002 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.034888:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6866033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686602c expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.034895:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a143fa39400/0xa8f741d1c6866041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686603a expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.034902:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a143fa38400/0xa8f741d1c686604f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6866048 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.034909:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a143fa38c00/0xa8f741d1c686606b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6866064 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.034915:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a143fa39600/0xa8f741d1c6866095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686608e expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.034925:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1400031400/0xa8f741d1c68660a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d46e2 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.034942:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1400031200/0xa8f741d1c68660aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d46e9 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.034951:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a14013a0000/0xa8f741d1c68660e2 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.034991:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1400031200/0xa8f741d1c68660aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d46e9 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.035006:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1400031200/0xa8f741d1c68660aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d46e9 expref: 9 pid: 5813 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708618.035021:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308529500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1876645426256384:192.168.202.53@tcp:104: 00010000:00010000:1.0:1789708618.035124:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1400031400/0xa8f741d1c68660a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d46e2 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.035133:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1400031400/0xa8f741d1c68660a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d46e2 expref: 9 pid: 5813 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708618.035142:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1876645426256512:192.168.202.53@tcp:104: 00010000:00010000:1.0:1789708618.035173:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a143fa39600/0xa8f741d1c6866095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c686608e expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.035181:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a143fa39600/0xa8f741d1c6866095 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c686608e expref: 18 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708618.035190:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130852a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1876645426256640:0@lo:104: 00000100:00100000:1.0:1789708618.035225:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708618.035453:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a143fa38c00/0xa8f741d1c686606b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6866064 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.035461:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a143fa38c00/0xa8f741d1c686606b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6866064 expref: 18 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708618.035470:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308529f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1876645426256768:0@lo:104: 00000100:00100000:1.0:1789708618.035493:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708618.035565:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a143fa38400/0xa8f741d1c686604f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6866048 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.035574:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a143fa38400/0xa8f741d1c686604f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6866048 expref: 18 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708618.035582:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1876645426256896:0@lo:104: 00010000:00010000:1.0:1789708618.035606:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a143fa39400/0xa8f741d1c6866041 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c686603a expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.035613:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a143fa39400/0xa8f741d1c6866041 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c686603a expref: 18 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708618.035622:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130852ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1876645426257024:0@lo:104: 00010000:00010000:1.0:1789708618.035680:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6866033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c686602c expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.035689:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6866033 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c686602c expref: 18 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708618.035696:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130852aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1876645426257152:0@lo:104: 00010000:00010000:1.0:1789708618.035719:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1401691200/0xa8f741d1c6866009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6866002 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.035734:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1401691200/0xa8f741d1c6866009 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6866002 expref: 18 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708618.035742:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130852b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1876645426257280:0@lo:104: 00010000:00010000:1.0:1789708618.035787:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1401691400/0xa8f741d1c6865fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6865fd8 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708618.035796:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1401691400/0xa8f741d1c6865fdf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6865fd8 expref: 18 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708618.035806:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1876645426257408:0@lo:104: 00000100:00100000:1.0:1789708618.035835:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13092f5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708618.035945:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789708618.035973:0:5803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708618.035988:0:5803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708618.035997:0:5803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708618.036006:0:5803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708618.036014:0:5803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708618.036022:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426256640 00000100:00100000:2.0:1789708618.036028:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426256640 00000100:00100000:2.0:1789708618.036065:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426256768 00000100:00100000:2.0:1789708618.036068:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426256768 00000100:00100000:2.0:1789708618.036077:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426256896 00000100:00100000:2.0:1789708618.036079:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426256896 00000100:00100000:2.0:1789708618.036088:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426257024 00000100:00100000:2.0:1789708618.036091:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426257024 00000100:00100000:2.0:1789708618.036100:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426257152 00000100:00100000:2.0:1789708618.036101:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426257152 00000100:00100000:2.0:1789708618.036111:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426257280 00000100:00100000:2.0:1789708618.036113:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426257280 00000100:00100000:2.0:1789708618.036123:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426257408 00000100:00100000:2.0:1789708618.036125:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426257408 00000100:00100000:2.0:1789708618.036138:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708618.036146:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130852b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+9:8428:x1876645426256640:12345-0@lo:104: 00010000:00010000:2.0:1789708618.036158:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c686608e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6866095 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.036226:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789708618.036232:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130852b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+9:8428:x1876645426256640:12345-0@lo:104: Request processed in 87us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708618.036239:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708618.036256:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789708618.036262:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434667050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+8:8428:x1876645426256768:12345-0@lo:104: 00010000:00010000:2.0:1789708618.036269:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6866064 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c686606b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.036303:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789708618.036308:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434667050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+8:8428:x1876645426256768:12345-0@lo:104: Request processed in 47us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708618.036314:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789708618.036353:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789708618.036360:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410809500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+7:8428:x1876645426256896:12345-0@lo:104: 00010000:00010000:2.0:1789708618.036368:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c686604f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.036395:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789708618.036400:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410809500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+7:8428:x1876645426256896:12345-0@lo:104: Request processed in 41us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708618.036405:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789708618.036417:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789708618.036424:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410808000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+6:8428:x1876645426257024:12345-0@lo:104: 00010000:00010000:3.0:1789708618.036431:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789708618.036432:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686603a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6866041 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.036439:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c686608e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6866095 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.036457:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400031e00 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:3.0:1789708618.036462:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c686608e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6866095 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.036472:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c686608e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6866095 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.036477:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:00010000:3.0:1789708618.036480:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c686608e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6866095 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708618.036485:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410808000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+6:8428:x1876645426257024:12345-0@lo:104: Request processed in 60us (494us total) trans 0 rc 0/0 10000000:01000000:3.0:1789708618.036493:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789708618.036499:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789708618.036516:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789708618.036524:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410809f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+5:8428:x1876645426257152:12345-0@lo:104: 00010000:00010000:3.0:1789708618.036529:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c686608e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866095 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.036533:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c686602c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6866033 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.036541:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708618.036560:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c686608e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866095 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.036568:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789708618.036576:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410809f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+5:8428:x1876645426257152:12345-0@lo:104: Request processed in 53us (576us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708618.036583:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c686608e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866095 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708618.036586:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1789708618.036603:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:2.0:1789708618.036605:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1789708618.036608:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6866064 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c686606b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708618.036616:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a141080a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+4:8428:x1876645426257280:12345-0@lo:104: 00010000:00010000:3.0:1789708618.036617:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b600 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:3.0:1789708618.036623:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6866064 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c686606b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.036628:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6866002 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6866009 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.036633:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6866064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c686606b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708618.036643:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6866064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c686606b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708618.036667:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789708618.036684:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6866064 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c686606b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.036684:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789708618.036693:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a141080a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+4:8428:x1876645426257280:12345-0@lo:104: Request processed in 80us (685us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708618.036695:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789708618.036704:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1789708618.036705:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6866064 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c686606b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.036713:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6866064 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c686606b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708618.036719:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1789708618.036729:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:2.0:1789708618.036730:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a141080b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:8428:x1876645426257408:12345-0@lo:104: 00010000:00010000:2.0:1789708618.036738:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1401691800/0xa8f741d1c6865fd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865fdf expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.036740:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c686604f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.036748:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14013a1000 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:3.0:1789708618.036753:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c686604f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.036761:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c686604f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708618.036768:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c686604f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708618.036784:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789708618.036792:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789708618.036798:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a141080b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:8428:x1876645426257408:12345-0@lo:104: Request processed in 71us (783us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708618.036802:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866048 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c686604f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708618.036806:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1789708618.036812:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708618.036827:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789708618.036831:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866048 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c686604f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.036839:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866048 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c686604f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.036850:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789708618.036853:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c686602c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6866033 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.036858:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14013a0c00 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:3.0:1789708618.036861:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c686602c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6866033 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.036944:0:8433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789708618.036951:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686603a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6866041 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.036958:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14013a1800 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:2.0:1789708618.036961:0:5807:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686603a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6866041 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.036968:0:5807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686603a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6866041 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708618.036974:0:5807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686603a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6866041 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708618.036979:0:5807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789708618.036994:0:5807:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686603a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866041 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.037000:0:5807:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708618.037006:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686603a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866041 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.037012:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686603a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866041 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.037032:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708618.037035:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1401691800/0xa8f741d1c6865fd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865fdf expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.037040:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1401691800 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:2.0:1789708618.037043:0:5807:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1401691800/0xa8f741d1c6865fd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6865fdf expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.037050:0:5807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1401691800/0xa8f741d1c6865fd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6865fdf expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708618.037056:0:5807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1401691800/0xa8f741d1c6865fd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6865fdf expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708618.037061:0:5807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789708618.037075:0:5807:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1401691800/0xa8f741d1c6865fd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865fdf expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.037081:0:5807:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708618.037085:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1401691800/0xa8f741d1c6865fd8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865fdf expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.037091:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1401691800/0xa8f741d1c6865fd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865fdf expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.037101:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708618.037102:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708618.037104:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708618.037178:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708618.037188:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6866002 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6866009 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.037195:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1401690e00 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:2.0:1789708618.037198:0:8433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6866002 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6866009 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.037205:0:8433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6866002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6866009 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708618.037211:0:8433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6866002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6866009 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708618.037216:0:8433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789708618.037228:0:8433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6866002 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866009 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.037233:0:8433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708618.037237:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6866002 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866009 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.037243:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1401690e00/0xa8f741d1c6866002 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866009 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.037252:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708618.037253:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708618.037255:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708618.037259:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708618.037260:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708618.037337:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130852a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1876645426256640:0@lo:104: 00000100:00100000:1.0:1789708618.037347:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308529f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1876645426256768:0@lo:104: 00000100:00100000:1.0:1789708618.037353:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1876645426256896:0@lo:104: 00000100:00100000:1.0:1789708618.037360:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130852ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1876645426257024:0@lo:104: 00000100:00100000:1.0:1789708618.037366:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130852aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1876645426257152:0@lo:104: 00000100:00100000:1.0:1789708618.037373:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130852b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1876645426257280:0@lo:104: 00000100:00100000:1.0:1789708618.037379:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1876645426257408:0@lo:104: 00000100:00100000:0.0:1789708618.037447:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:3.0:1789708618.038106:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c686602c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6866033 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708618.038119:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c686602c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6866033 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708618.038125:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789708618.038150:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426257664:0@lo:103: 00010000:00010000:3.0:1789708618.038158:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c686602c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866033 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.038165:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708618.038171:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c686602c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866033 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.038177:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c686602c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866033 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.038193:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708618.038194:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708618.038196:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708618.038200:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708618.038212:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426257792:0@lo:103: 00000100:00100000:0.0:1789708618.038242:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130852b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426258176:0@lo:103: 00000100:00100000:2.0:1789708618.038287:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426257664 00000100:00100000:2.0:1789708618.038292:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426257664 00010000:00010000:2.0:1789708618.038320:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a143fa38c00/0xa8f741d1c686606b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6866064 expref: 19 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708618.038345:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708618.038353:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426257664:12345-0@lo:103: 00010000:00010000:2.0:1789708618.038364:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708618.038369:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a143fa38c00/0xa8f741d1c686606b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6866064 expref: 19 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.038379:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a143fa38c00/0xa8f741d1c686606b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6866064 expref: 19 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.038392:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa38c00/0xa8f741d1c686606b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6866064 expref: 19 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.038403:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708618.038955:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708618.038990:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426257920:0@lo:103: 00000100:00100000:2.0:1789708618.038992:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:3289:x1876645426257664:12345-0@lo:103: Request processed in 638us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708618.039004:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789708618.039110:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426257664:0@lo:103: 00000100:00100000:3.0:1789708618.039119:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426258176 00000100:00100000:0.0:1789708618.039124:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789708618.039126:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426258176 00000100:00100000:0.0:1789708618.039133:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426257536:0@lo:103: 00010000:00010000:3.0:1789708618.039150:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1401691200/0xa8f741d1c6866009 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6866002 expref: 18 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708618.039160:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708618.040731:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426258048:0@lo:103: 00000100:00100000:0.0:1789708618.040763:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708618.040826:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426257536 00000100:00100000:3.0:1789708618.040842:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426257536 00000100:00100000:0.0:1789708618.040863:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426258048 00010000:00010000:3.0:1789708618.040867:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a143fa39600/0xa8f741d1c6866095 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c686608e expref: 19 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708618.040868:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426258048 00010000:00010000:0.0:1789708618.040899:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1401691400/0xa8f741d1c6865fdf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865fd8 expref: 20 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708618.040913:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789708618.040925:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+20:3289:x1876645426258176:12345-0@lo:103: 00000100:00100000:0.0:1789708618.040926:0:5804:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789708618.040936:0:5804:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789708618.040942:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708618.040949:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1401691200/0xa8f741d1c6866009 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6866002 expref: 20 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.040962:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1401691200/0xa8f741d1c6866009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6866002 expref: 20 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.040981:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1401691200/0xa8f741d1c6866009 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6866002 expref: 20 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.040998:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708618.041047:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426258176:12345-0@lo:103: Request processed in 125us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708618.041057:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789708618.041100:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789708618.041111:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:3289:x1876645426257536:12345-0@lo:103: 00010000:00010000:3.0:1789708618.041121:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708618.041126:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a143fa39600/0xa8f741d1c6866095 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c686608e expref: 18 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.041137:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a143fa39600/0xa8f741d1c6866095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c686608e expref: 18 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.041150:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa39600/0xa8f741d1c6866095 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c686608e expref: 18 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708618.041166:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708618.041169:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708618.041199:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708618.041209:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:3289:x1876645426257536:12345-0@lo:103: Request processed in 100us (2048us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708618.041216:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426258304:0@lo:103: 00000100:00100000:3.0:1789708618.041218:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789708618.041242:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426257920 00000100:00100000:0.0:1789708618.041246:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708618.041248:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426257920 00010000:00010000:3.0:1789708618.041265:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a143fa39400/0xa8f741d1c6866041 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c686603a expref: 17 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708618.041278:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426257536:0@lo:103: 00000100:00100000:3.0:1789708618.041284:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426257792 00000100:00100000:3.0:1789708618.041289:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426257792 00000100:00100000:0.0:1789708618.041289:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130852b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426258176:0@lo:103: 00010000:00010000:3.0:1789708618.041305:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a143fa38400/0xa8f741d1c686604f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6866048 expref: 18 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708618.041325:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426258304 00000100:00100000:3.0:1789708618.041328:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426258304 00000100:00100000:0.0:1789708618.041336:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1789708618.041343:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6866033 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c686602c expref: 19 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708618.041348:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426258048:12345-0@lo:103: 00010000:00010000:0.0:1789708618.041360:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708618.041366:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1401691400/0xa8f741d1c6865fdf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865fd8 expref: 19 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708618.041367:0:5805:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1789708618.041379:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1401691400/0xa8f741d1c6865fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6865fd8 expref: 19 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708618.041383:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1789708618.041396:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1401691400/0xa8f741d1c6865fdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6865fd8 expref: 19 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708618.041397:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3287:x1876645426257920:12345-0@lo:103: 00010000:00010000:3.0:1789708618.041412:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708618.041412:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708618.041419:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a143fa39400/0xa8f741d1c6866041 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c686603a expref: 18 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.041429:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a143fa39400/0xa8f741d1c6866041 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c686603a expref: 18 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708618.041439:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:3289:x1876645426258048:12345-0@lo:103: Request processed in 94us (674us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708618.041444:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa39400/0xa8f741d1c6866041 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c686603a expref: 18 pid: 5814 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708618.041447:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789708618.041461:0:5804:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1789708618.041465:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708618.041469:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789708618.041476:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:3286:x1876645426257792:12345-0@lo:103: 00010000:00010000:0.0:1789708618.041484:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708618.041488:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a143fa38400/0xa8f741d1c686604f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6866048 expref: 16 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708618.041497:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a143fa38400/0xa8f741d1c686604f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6866048 expref: 16 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708618.041507:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa38400/0xa8f741d1c686604f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6866048 expref: 16 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708618.041514:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:3287:x1876645426257920:12345-0@lo:103: Request processed in 119us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708618.041529:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1789708618.041530:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708618.041550:0:5805:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789708618.041562:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789708618.041563:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:3286:x1876645426257792:12345-0@lo:103: Request processed in 86us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708618.041573:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789708618.041574:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1408280850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:3286:x1876645426258304:12345-0@lo:103: 00010000:00010000:3.0:1789708618.041585:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708618.041591:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6866033 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c686602c expref: 13 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708618.041599:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e163b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426258048:0@lo:103: 00010000:00010000:3.0:1789708618.041601:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6866033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c686602c expref: 13 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.041618:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6866033 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c686602c expref: 13 pid: 5813 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708618.041623:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426257792:0@lo:103: 00010000:00010000:3.0:1789708618.041632:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708618.041699:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1408280850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:3286:x1876645426258304:12345-0@lo:103: Request processed in 129us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708618.041707:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789708618.041790:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426257920:0@lo:103: 00000100:00100000:3.0:1789708618.041828:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426258304:0@lo:103: 00000100:00100000:1.0:1789708618.042220:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708618.042249:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708618.042299:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415751808 00000100:00100000:0.0:1789708618.042308:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415751808 00000100:00100000:2.0:1789708618.042311:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415751936 00000100:00100000:3.0:1789708618.042312:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308529500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1876645426256384:192.168.202.53@tcp:104: 00000100:00100000:2.0:1789708618.042316:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415751936 00010000:00010000:0.0:1789708618.042328:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1400031200/0xa8f741d1c68660aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d46e9 expref: 11 pid: 5813 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708618.042330:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1876645426256512:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708618.042334:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1400031400/0xa8f741d1c68660a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d46e2 expref: 11 pid: 5813 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708618.042367:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:2.0:1789708618.042375:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:0.0:1789708618.042377:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7afaea2d-d635-45b7-851c-2e40ec565b3d+11:2362:x1876645415751808:12345-192.168.202.53@tcp:103: 00000100:00100000:2.0:1789708618.042383:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7afaea2d-d635-45b7-851c-2e40ec565b3d+11:2361:x1876645415751936:12345-192.168.202.53@tcp:103: 00010000:00010000:0.0:1789708618.042385:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708618.042389:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708618.042391:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1400031200/0xa8f741d1c68660aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d46e9 expref: 11 pid: 5813 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708618.042393:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a14013a0000/0xa8f741d1c68660e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.042394:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1400031400/0xa8f741d1c68660a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d46e2 expref: 11 pid: 5813 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708618.042401:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1400031200/0xa8f741d1c68660aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d46e9 expref: 11 pid: 5813 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.042422:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1400031400/0xa8f741d1c68660a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d46e2 expref: 11 pid: 5813 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708618.042469:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400031200/0xa8f741d1c68660aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d46e9 expref: 11 pid: 5813 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.042471:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400031400/0xa8f741d1c68660a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d46e2 expref: 11 pid: 5813 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.042483:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a14013a0000/0xa8f741d1c68660e2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.042492:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a14013a0000/0xa8f741d1c68660e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708618.042498:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708618.042504:0:8435:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a14013a0000/0xa8f741d1c68660e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.042510:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a14013a0000/0xa8f741d1c68660e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.042516:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a14013a0000/0xa8f741d1c68660e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.042522:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a14013a0000/0xa8f741d1c68660e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.042528:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14013a0000 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:2.0:1789708618.042532:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a14013a0000/0xa8f741d1c68660e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708618.042537:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:2362:x1876645415751808:12345-192.168.202.53@tcp:103: Request processed in 164us (318us total) trans 0 rc 0/0 00010000:00010000:2.0:1789708618.042540:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a14013a0000/0xa8f741d1c68660e2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708618.042551:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00010000:00010000:2.0:1789708618.042567:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a14013a0000/0xa8f741d1c68660e2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.042577:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708618.042592:0:8428:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a14013a0000/0xa8f741d1c68660e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708618.042597:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7afaea2d-d635-45b7-851c-2e40ec565b3d+8:2361:x1876645415751936:12345-192.168.202.53@tcp:103: Request processed in 216us (347us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708618.042601:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a14013a0000/0xa8f741d1c68660e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708618.042603:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00010000:00010000:1.0:1789708618.042612:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a14013a0000/0xa8f741d1c68660e2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708618.878841:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789708619.130898:0:5816:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789708619.130906:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1302f7e800 from 39 10000000:01000000:1.0:1789708619.130911:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789708619.130961:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a0000/0xa8f741d1c68660e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708619.130974:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a14013a0000/0xa8f741d1c68660e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708619.130985:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a14013a0000/0xa8f741d1c68660e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708619.131011:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426258432:0@lo:101: 00000100:00100000:1.0:1789708619.131635:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708619.131716:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13092f5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708619.131803:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426258432 00000100:00100000:0.0:1789708619.131810:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426258432 00000100:00100000:0.0:1789708619.131864:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789708619.131873:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+12:5816:x1876645426258432:12345-0@lo:101: 00010000:00010000:0.0:1789708619.131886:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708619.131900:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400031200/0xa8f741d1c68660f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c68660e9 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708619.131921:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400031200/0xa8f741d1c68660f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c68660e9 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708619.131930:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400031200/0xa8f741d1c68660f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c68660e9 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708619.131938:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400031200, rc 0) 00000100:00100000:0.0:1789708619.131986:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:5816:x1876645426258432:12345-0@lo:101: Request processed in 115us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708619.131993:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789708619.132332:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426258432:0@lo:101: 00010000:00010000:2.0:1789708619.132349:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a14013a0000/0xa8f741d1c68660e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68660f0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708619.132360:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a14013a0000/0xa8f741d1c68660e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c68660f0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708619.132417:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426258560:0@lo:501: 00000100:00100000:2.0:1789708619.132448:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708619.132469:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4b600 going to sleep for 11 seconds 00000100:00100000:0.0:1789708619.132497:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426258560 00000100:00100000:0.0:1789708619.132502:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426258560 00000100:00100000:0.0:1789708619.132572:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789708619.132581:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140309fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:5816:x1876645426258560:12345-0@lo:501: 00000100:00100000:0.0:1789708619.132906:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140309fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:5816:x1876645426258560:12345-0@lo:501: Request processed in 327us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708619.132914:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789708619.132980:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426258560:0@lo:501: 00000100:00100000:2.0:1789708619.133022:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426258688:0@lo:503: 00000100:00100000:2.0:1789708619.133072:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708619.133313:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4b600 going to sleep for 11 seconds 00000100:00100000:1.0:1789708619.133433:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426258688 00000100:00100000:1.0:1789708619.133439:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426258688 00000100:00100000:1.0:1789708619.133460:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789708619.133466:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:5816:x1876645426258688:12345-0@lo:503: 00000100:00100000:1.0:1789708619.133637:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:5816:x1876645426258688:12345-0@lo:503: Request processed in 170us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708619.133644:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789708619.133747:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426258688:0@lo:503: 00000100:00100000:2.0:1789708619.134695:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8447:1876645426258816:0@lo:502: 00000100:00100000:2.0:1789708619.134816:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708619.134941:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789708619.134981:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426258816 00000100:00100000:1.0:1789708619.134986:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426258816 00000100:00100000:1.0:1789708619.135069:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789708619.135084:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:8447:x1876645426258816:12345-0@lo:502: 00000100:00100000:1.0:1789708619.135395:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:8447:x1876645426258816:12345-0@lo:502: Request processed in 312us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708619.135403:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789708619.135471:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8447:1876645426258816:0@lo:502: 00000100:00100000:2.0:1789708619.135514:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8447:1876645426258944:0@lo:502: 00000100:00100000:2.0:1789708619.135546:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708619.135617:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789708619.135702:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426258944 00000100:00100000:0.0:1789708619.135713:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426258944 00000100:00100000:0.0:1789708619.135742:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789708619.135750:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:8447:x1876645426258944:12345-0@lo:502: 00000100:00100000:0.0:1789708619.135903:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:8447:x1876645426258944:12345-0@lo:502: Request processed in 154us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708619.135909:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789708619.135985:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8447:1876645426258944:0@lo:502: 00000040:00080000:2.0:1789708619.136004:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789708619.136213:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789708619.136239:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789708619.136249:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a0000/0xa8f741d1c68660e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68660f0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708619.136270:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a14013a0000/0xa8f741d1c68660e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68660f0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708619.136279:0:5816:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789708619.136282:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789708619.136284:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789708619.136308:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400030200/0xa8f741d1c68660f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708619.136316:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1400030200/0xa8f741d1c68660f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708619.136325:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1400030200/0xa8f741d1c68660f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708619.136336:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426259072:0@lo:101: 00000100:00100000:0.0:1789708619.136366:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708619.136396:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405876d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708619.136489:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426259072 00000100:00100000:2.0:1789708619.136494:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426259072 00000100:00100000:2.0:1789708619.136513:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789708619.136518:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+13:5816:x1876645426259072:12345-0@lo:101: 00010000:00010000:2.0:1789708619.136527:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708619.136537:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1403b6a200/0xa8f741d1c68660fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c68660f7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708619.136557:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1403b6a200/0xa8f741d1c68660fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c68660f7 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708619.136566:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1403b6a200/0xa8f741d1c68660fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c68660f7 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708619.136575:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6a200, rc 0) 00000100:00100000:2.0:1789708619.136607:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:5816:x1876645426259072:12345-0@lo:101: Request processed in 88us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708619.136613:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789708619.136686:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426259072:0@lo:101: 00010000:00010000:0.0:1789708619.136705:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1400030200/0xa8f741d1c68660f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68660fe expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708619.136713:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1400030200/0xa8f741d1c68660f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c68660fe expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708619.136752:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426259200:0@lo:501: 00000100:00100000:0.0:1789708619.136787:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708619.136809:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405876d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708619.136886:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426259200 00000100:00100000:2.0:1789708619.136890:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426259200 00000100:00100000:2.0:1789708619.136908:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789708619.136919:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:5816:x1876645426259200:12345-0@lo:501: 00000100:00100000:2.0:1789708619.137123:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:5816:x1876645426259200:12345-0@lo:501: Request processed in 203us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708619.137130:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789708619.137244:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426259200:0@lo:501: 00000100:00100000:0.0:1789708619.137292:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426259328:0@lo:503: 00000100:00100000:0.0:1789708619.137327:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708619.137349:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405876d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708619.137463:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426259328 00000100:00100000:2.0:1789708619.137468:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426259328 00000100:00100000:2.0:1789708619.137486:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789708619.137492:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:5816:x1876645426259328:12345-0@lo:503: 00000100:00100000:2.0:1789708619.137632:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:5816:x1876645426259328:12345-0@lo:503: Request processed in 140us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708619.137639:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789708619.137722:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426259328:0@lo:503: 00000100:00100000:0.0:1789708619.138115:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb2aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8448:1876645426259456:0@lo:502: 00000100:00100000:0.0:1789708619.138150:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708619.138178:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14058760c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708619.138239:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426259456 00000100:00100000:3.0:1789708619.138243:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426259456 00000100:00100000:2.0:1789708619.138364:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789708619.138373:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:8448:x1876645426259456:12345-0@lo:502: 00000100:00100000:0.0:1789708619.138731:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb2aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8448:1876645426259456:0@lo:502: 00000020:01000000:0.0:1789708619.138767:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708619.138777:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708619.138779:0:8448:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789708619.138785:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789708619.138807:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb2aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8448:1876645426259584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708619.138844:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708619.138881:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14058760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708619.138965:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:8448:x1876645426259456:12345-0@lo:502: Request processed in 389us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708619.138973:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789708619.138984:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426259584 00000100:00100000:1.0:1789708619.138989:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426259584 00000100:00100000:2.0:1789708619.139015:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789708619.139022:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:8448:x1876645426259584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708619.139142:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:8448:x1876645426259584:12345-0@lo:502:llog_process_th.0 Request processed in 121us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708619.139146:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789708619.139189:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb2aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8448:1876645426259584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789708619.139209:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708619.139212:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708619.139213:0:8448:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789708619.139216:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1789708619.139294:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789708619.139321:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789708619.139328:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400030200/0xa8f741d1c68660f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68660fe expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708619.139336:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1400030200/0xa8f741d1c68660f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68660fe expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708619.139343:0:5816:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789708619.139344:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a143fa6b000 from 39 10000000:01000000:1.0:1789708619.139346:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789708619.139364:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c6866105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708619.139369:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c6866105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708619.139375:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c6866105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708619.139386:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426259712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789708619.139412:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708619.139471:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13092f5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708619.139518:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426259712 00000100:00100000:3.0:1789708619.139522:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426259712 00000100:00100000:3.0:1789708619.139549:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789708619.139560:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:5816:x1876645426259712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708619.139569:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708619.139582:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa38a00/0xa8f741d1c686610c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6866105 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708619.139602:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa38a00/0xa8f741d1c686610c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6866105 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708619.139612:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa38a00/0xa8f741d1c686610c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6866105 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708619.139620:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38a00, rc 0) 00000100:00100000:3.0:1789708619.139675:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:5816:x1876645426259712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708619.139681:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789708619.139701:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426259712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708619.139739:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c6866105 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686610c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708619.139750:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c6866105 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c686610c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708619.139803:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426259840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708619.139834:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708619.139871:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13092f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708619.139949:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426259840 00000100:00100000:0.0:1789708619.139955:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426259840 00000100:00100000:0.0:1789708619.139984:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789708619.140004:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:5816:x1876645426259840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708619.140242:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:5816:x1876645426259840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708619.140247:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789708619.140773:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426259840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708619.140804:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426259968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708619.140835:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708619.140861:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789708619.140878:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426259968 00000100:00100000:3.0:1789708619.140882:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426259968 00000100:00100000:3.0:1789708619.140908:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789708619.140916:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:5816:x1876645426259968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708619.141099:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:5816:x1876645426259968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708619.141107:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789708619.141168:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426259968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708619.141693:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8449:1876645426260096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708619.141730:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708619.141806:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4b540 going to sleep for 11 seconds 00000100:00100000:1.0:1789708619.141836:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426260096 00000100:00100000:1.0:1789708619.141840:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426260096 00000100:00100000:1.0:1789708619.141870:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789708619.141877:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:8449:x1876645426260096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708619.142086:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:8449:x1876645426260096:12345-0@lo:502:llog_process_th.0 Request processed in 208us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708619.142092:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789708619.142152:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8449:1876645426260096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708619.142188:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8449:1876645426260224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708619.142281:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708619.142342:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4b540 going to sleep for 11 seconds 00000100:00100000:3.0:1789708619.142371:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426260224 00000100:00100000:3.0:1789708619.142376:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426260224 00000100:00100000:3.0:1789708619.142401:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789708619.142408:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:8449:x1876645426260224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708619.142673:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:8449:x1876645426260224:12345-0@lo:502:llog_process_th.0 Request processed in 264us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708619.142681:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789708619.142800:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8449:1876645426260224:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789708619.142816:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789708619.142951:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789708619.142974:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789708619.142982:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c6866105 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686610c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708619.142991:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c6866105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686610c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708619.143001:0:5816:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789708619.143003:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789708619.143006:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789708619.143028:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708619.143042:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708619.143051:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866113 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708619.143065:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426260352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789708619.143093:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708619.143121:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13092f5300 going to sleep for 11 seconds 00000100:00100000:0.0:1789708619.143127:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426260352 00000100:00100000:0.0:1789708619.143132:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426260352 00000100:00100000:0.0:1789708619.143164:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789708619.143169:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:5816:x1876645426260352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708619.143215:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708619.143226:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400030a00/0xa8f741d1c686611a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6866113 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708619.143243:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400030a00/0xa8f741d1c686611a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6866113 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708619.143250:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400030a00/0xa8f741d1c686611a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6866113 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708619.143255:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400030a00, rc 0) 00000100:00100000:0.0:1789708619.143285:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:5816:x1876645426260352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708619.143297:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789708619.143320:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426260352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708619.143333:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866113 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686611a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708619.143342:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866113 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c686611a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708619.143378:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426260480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708619.143402:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708619.143459:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13092f5300 going to sleep for 11 seconds 00000100:00100000:3.0:1789708619.143547:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426260480 00000100:00100000:3.0:1789708619.143551:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426260480 00000100:00100000:3.0:1789708619.143606:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789708619.143614:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:5816:x1876645426260480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708619.143848:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:5816:x1876645426260480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708619.143855:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789708619.143920:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426260480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708619.143953:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426260608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708619.143990:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708619.144084:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13092f5300 going to sleep for 11 seconds 00000100:00100000:2.0:1789708619.144150:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426260608 00000100:00100000:2.0:1789708619.144155:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426260608 00000100:00100000:2.0:1789708619.144175:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789708619.144181:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:5816:x1876645426260608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708619.144337:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:5816:x1876645426260608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708619.144344:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789708619.144423:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426260608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708619.145263:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8450:1876645426260736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708619.145310:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708619.145339:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13092f5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708619.145384:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426260736 00000100:00100000:2.0:1789708619.145389:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426260736 00000100:00100000:2.0:1789708619.145420:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789708619.145427:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:8450:x1876645426260736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708619.145584:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:8450:x1876645426260736:12345-0@lo:502:llog_process_th.0 Request processed in 157us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708619.145591:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789708619.145687:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8450:1876645426260736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789708619.145709:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708619.145717:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708619.145719:0:8450:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789708619.145725:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789708619.145743:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8450:1876645426260864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708619.145786:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708619.145802:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f632cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708619.145919:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426260864 00000100:00100000:2.0:1789708619.145924:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426260864 00000100:00100000:2.0:1789708619.145942:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789708619.145949:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:8450:x1876645426260864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708619.146061:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:8450:x1876645426260864:12345-0@lo:502:llog_process_th.0 Request processed in 111us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708619.146068:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789708619.146137:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8450:1876645426260864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789708619.146155:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708619.146159:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708619.146161:0:8450:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789708619.146165:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1789708619.146396:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1789708619.146418:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789708619.146427:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866113 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686611a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708619.146438:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686611a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708619.146448:0:5816:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789708619.146450:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1410604800 from 39 10000000:01000000:2.0:1789708619.146453:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789708619.146469:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a800/0xa8f741d1c6866121 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708619.146475:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a800/0xa8f741d1c6866121 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708619.146489:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a800/0xa8f741d1c6866121 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708619.146498:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426260992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789708619.146518:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708619.146545:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4b780 going to sleep for 11 seconds 00000100:00100000:3.0:1789708619.146617:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426260992 00000100:00100000:3.0:1789708619.146622:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426260992 00000100:00100000:3.0:1789708619.146675:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789708619.146682:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:5816:x1876645426260992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708619.146690:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708619.146701:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6866128 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6866121 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708619.146719:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6866128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6866121 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708619.146729:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6866128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6866121 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708619.146747:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39200, rc 0) 00000100:00100000:3.0:1789708619.146790:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426260992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708619.146796:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789708619.146972:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426260992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708619.146983:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a800/0xa8f741d1c6866121 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866128 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708619.146991:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a800/0xa8f741d1c6866121 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6866128 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708619.147029:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426261120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708619.147052:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708619.147067:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4b780 going to sleep for 11 seconds 00000100:00100000:3.0:1789708619.148830:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426261120 00000100:00100000:3.0:1789708619.148839:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426261120 00000100:00100000:3.0:1789708619.148888:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789708619.148896:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426261120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708619.149144:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426261120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (2090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708619.149151:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789708619.149291:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426261120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708619.149339:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426261248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708619.149386:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708619.149406:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4b780 going to sleep for 11 seconds 00000100:00100000:3.0:1789708619.149553:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426261248 00000100:00100000:3.0:1789708619.149557:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426261248 00000100:00100000:3.0:1789708619.149614:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789708619.149622:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426261248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708619.149798:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426261248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708619.149805:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789708619.149874:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426261248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708619.150047:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8451:1876645426261376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708619.150080:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708619.151819:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708619.151861:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426261376 00000100:00100000:0.0:1789708619.151869:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426261376 00000100:00100000:0.0:1789708619.151911:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789708619.151920:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:8451:x1876645426261376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708619.152172:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:8451:x1876645426261376:12345-0@lo:502:llog_process_th.0 Request processed in 253us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708619.152180:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789708619.152295:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8451:1876645426261376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708619.152350:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8451:1876645426261504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708619.152394:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708619.152410:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708619.152596:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426261504 00000100:00100000:1.0:1789708619.152601:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426261504 00000100:00100000:1.0:1789708619.152624:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789708619.152631:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:8451:x1876645426261504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708619.152913:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:8451:x1876645426261504:12345-0@lo:502:llog_process_th.0 Request processed in 281us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708619.152920:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789708619.153266:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8451:1876645426261504:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789708619.153298:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789708619.153444:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789708619.153464:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789708619.153473:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a800/0xa8f741d1c6866121 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866128 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708619.153573:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a800/0xa8f741d1c6866121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866128 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708619.153592:0:5816:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789708619.153595:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789708619.153598:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789708619.153622:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa39400/0xa8f741d1c686612f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708619.153629:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143fa39400/0xa8f741d1c686612f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708619.153638:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143fa39400/0xa8f741d1c686612f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708619.153679:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426261632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708619.153713:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708619.154435:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f1e3180 going to sleep for 11 seconds 00000100:00100000:0.0:1789708619.154611:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426261632 00000100:00100000:0.0:1789708619.154615:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426261632 00000100:00100000:3.0:1789708619.154804:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789708619.154814:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426261632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708619.154826:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708619.154843:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa39600/0xa8f741d1c6866136 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c686612f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708619.154863:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa39600/0xa8f741d1c6866136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c686612f expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708619.154873:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa39600/0xa8f741d1c6866136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686612f expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708619.154880:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39600, rc 0) 00000100:00100000:3.0:1789708619.154955:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426261632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708619.154962:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789708619.155019:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426261632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708619.155033:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143fa39400/0xa8f741d1c686612f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866136 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708619.155042:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143fa39400/0xa8f741d1c686612f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6866136 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708619.155095:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426261760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708619.155123:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708619.155187:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708619.155271:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426261760 00000100:00100000:0.0:1789708619.155276:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426261760 00000100:00100000:0.0:1789708619.155338:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789708619.155346:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426261760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708619.155671:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426261760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708619.155677:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789708619.155745:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426261760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708619.155788:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426261888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708619.155822:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708619.155917:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708619.155963:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426261888 00000100:00100000:1.0:1789708619.155968:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426261888 00000100:00100000:1.0:1789708619.155986:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789708619.155992:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426261888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708619.156138:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426261888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708619.156150:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789708619.156275:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426261888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708619.156599:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8452:1876645426262016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708619.156624:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708619.156644:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4b900 going to sleep for 11 seconds 00000100:00100000:1.0:1789708619.156744:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426262016 00000100:00100000:1.0:1789708619.156749:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426262016 00000100:00100000:1.0:1789708619.156780:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789708619.156787:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:8452:x1876645426262016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708619.156922:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:8452:x1876645426262016:12345-0@lo:502:llog_process_th.0 Request processed in 136us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708619.156926:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789708619.156976:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8452:1876645426262016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708619.156997:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708619.157005:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708619.157007:0:8452:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789708619.157013:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789708619.157031:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8452:1876645426262144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708619.157059:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708619.157079:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4b900 going to sleep for 11 seconds 00000100:00100000:1.0:1789708619.157108:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426262144 00000100:00100000:1.0:1789708619.157111:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426262144 00000100:00100000:1.0:1789708619.157123:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789708619.157126:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:8452:x1876645426262144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708619.157312:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:8452:x1876645426262144:12345-0@lo:502:llog_process_th.0 Request processed in 184us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708619.157317:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789708619.157372:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8452:1876645426262144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708619.157390:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708619.157394:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708619.157396:0:8452:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789708619.157399:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789708619.157555:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1789708619.157576:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789708619.157582:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa39400/0xa8f741d1c686612f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866136 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708619.157590:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa39400/0xa8f741d1c686612f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866136 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708619.157597:0:5816:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789708619.157598:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a1407ea19c0 from 1 10000000:01000000:1.0:1789708619.157600:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789708619.157617:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686613d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708619.157626:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686613d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708619.157633:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686613d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708619.157641:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426262272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789708619.157676:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708619.157687:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13092f5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708619.157694:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426262272 00000100:00100000:1.0:1789708619.157697:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426262272 00000100:00100000:1.0:1789708619.157709:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789708619.157712:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426262272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708619.157718:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708619.157726:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a14013a0600/0xa8f741d1c6866144 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c686613d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708619.157739:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a14013a0600/0xa8f741d1c6866144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c686613d expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708619.157746:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a14013a0600/0xa8f741d1c6866144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686613d expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708619.157751:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14013a0600, rc 0) 00000100:00100000:1.0:1789708619.157785:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426262272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708619.157795:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789708619.157828:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426262272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708619.157844:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686613d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866144 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708619.157852:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686613d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6866144 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708619.157887:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426262400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708619.157911:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708619.157963:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13092f5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708619.158037:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426262400 00000100:00100000:0.0:1789708619.158042:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426262400 00000100:00100000:0.0:1789708619.158094:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789708619.158100:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426262400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708619.158338:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426262400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (427us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789708619.158345:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789708619.158395:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426262400:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789708619.158420:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789708619.158424:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686613d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866144 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708619.158429:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686613d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866144 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708619.448751:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708619.448839:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415752064 00000100:00100000:3.0:1789708619.448847:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415752064 00000100:00100000:3.0:1789708619.448890:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 158 00000100:00100000:3.0:1789708619.448898:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+8:5595:x1876645415752064:12345-192.168.202.53@tcp:101: 00010000:00010000:3.0:1789708619.448911:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708619.448924:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa39000/0xa8f741d1c686614b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d474b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708619.448949:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa39000/0xa8f741d1c686614b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d474b expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708619.448961:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa39000/0xa8f741d1c686614b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d474b expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708619.448971:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39000, rc 0) 00000100:00100000:3.0:1789708619.449028:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:5595:x1876645415752064:12345-192.168.202.53@tcp:101: Request processed in 130us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708619.449034:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 158 00000100:00100000:3.0:1789708619.452811:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708619.452885:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415752192 00000100:00100000:0.0:1789708619.452895:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415752192 00000100:00100000:0.0:1789708619.452969:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 159 00000100:00100000:0.0:1789708619.452980:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:5595:x1876645415752192:12345-192.168.202.53@tcp:501: 00000100:00100000:0.0:1789708619.453293:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:5595:x1876645415752192:12345-192.168.202.53@tcp:501: Request processed in 314us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708619.453301:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 159 00000100:00100000:1.0:1789708619.454951:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708619.456803:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415752320 00000100:00100000:3.0:1789708619.456818:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415752320 00000100:00100000:0.0:1789708619.457436:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 160 00000100:00100000:0.0:1789708619.457453:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:5595:x1876645415752320:12345-192.168.202.53@tcp:503: 00000100:00100000:0.0:1789708619.457833:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:5595:x1876645415752320:12345-192.168.202.53@tcp:503: Request processed in 386us (2887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708619.457843:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 160 00000100:00100000:1.0:1789708619.469118:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708619.469190:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415752448 00000100:00100000:2.0:1789708619.469199:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415752448 00000100:00100000:2.0:1789708619.469255:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 161 00000100:00100000:2.0:1789708619.469262:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:6066:x1876645415752448:12345-192.168.202.53@tcp:502: 00000100:00100000:2.0:1789708619.469579:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:6066:x1876645415752448:12345-192.168.202.53@tcp:502: Request processed in 316us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708619.469585:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 161 00000100:00100000:3.0:1789708619.471206:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708619.471454:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415752576 00000100:00100000:0.0:1789708619.471462:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415752576 00000100:00100000:0.0:1789708619.471564:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 162 00000100:00100000:0.0:1789708619.471577:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:6066:x1876645415752576:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789708619.471922:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:6066:x1876645415752576:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 347us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708619.471941:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 162 00000100:00100000:1.0:1789708619.476706:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708619.476873:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415752704 00000100:00100000:2.0:1789708619.476882:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415752704 00000100:00100000:2.0:1789708619.476949:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 163 00000100:00100000:2.0:1789708619.476960:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:5595:x1876645415752704:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708619.476976:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708619.476995:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1403b6b400/0xa8f741d1c6866152 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4752 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708619.477024:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1403b6b400/0xa8f741d1c6866152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4752 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708619.477035:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1403b6b400/0xa8f741d1c6866152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4752 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708619.477060:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6b400, rc 0) 00000100:00100000:2.0:1789708619.477115:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:5595:x1876645415752704:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 157us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708619.477123:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 163 00000100:00100000:1.0:1789708619.483056:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708619.483194:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415752832 00000100:00100000:0.0:1789708619.483204:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415752832 00000100:00100000:0.0:1789708619.483273:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 164 00000100:00100000:0.0:1789708619.483286:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:5595:x1876645415752832:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708619.483733:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:5595:x1876645415752832:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 449us (686us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789708619.483743:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 164 00010000:00010000:2.0:1789708619.899242:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708620.028933:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708620.029833:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426262528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708620.029906:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708620.029974:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426262528 00000100:00100000:2.0:1789708620.029984:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426262528 00000100:00100000:2.0:1789708620.030067:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789708620.030076:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426262528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789708620.030112:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789708620.030161:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426262528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708620.030169:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789708620.030795:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789708620.032850:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14037bb480 x1876645426262528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708636 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708620.032893:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426262528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708620.542701:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426262656:0@lo:400:kworker.0 00000100:00100000:0.0:1789708620.542783:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708620.542815:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426262656 00000100:00100000:0.0:1789708620.542831:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876645426263168:0@lo:400:kworker.0 00000100:00100000:1.0:1789708620.542834:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426262656 00000100:00100000:0.0:1789708620.542855:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708620.542880:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789708620.542884:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789708620.542886:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426262784:0@lo:400:kworker.0 00000100:00100000:1.0:1789708620.542893:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3288:x1876645426262656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708620.542905:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708620.542923:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426263296:0@lo:400:kworker.0 00000100:00100000:1.0:1789708620.542938:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3288:x1876645426262656:12345-0@lo:400:kworker.0 Request processed in 47us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708620.542944:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708620.542945:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789708620.542971:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426262656:0@lo:400:kworker.0 00000100:00100000:1.0:1789708620.542986:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426263040:0@lo:400:kworker.0 00000100:00100000:1.0:1789708620.543010:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708620.543029:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789708620.543035:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426262912:0@lo:400:kworker.0 00000100:00100000:1.0:1789708620.543054:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708620.543071:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426263424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708620.543092:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708620.543125:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426263168 00000100:00100000:1.0:1789708620.543130:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426263296 00000100:00100000:0.0:1789708620.543130:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426263168 00000100:00100000:1.0:1789708620.543132:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426263296 00000100:00100000:0.0:1789708620.543164:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426262784 00000100:00100000:0.0:1789708620.543167:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426262784 00000100:00100000:0.0:1789708620.543185:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426262912 00000100:00100000:0.0:1789708620.543188:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426262912 00000100:00100000:2.0:1789708620.543381:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426263040 00000100:00100000:2.0:1789708620.543385:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426263040 00000100:00100000:2.0:1789708620.543414:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789708620.543422:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426263040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708620.543466:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426263040:12345-0@lo:400:kworker.0 Request processed in 45us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708620.543473:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789708620.543556:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426263424 00000100:00100000:2.0:1789708620.543560:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426263424 00000100:00100000:2.0:1789708620.543586:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789708620.543593:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1876645426263424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789708620.543624:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789708620.543711:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1876645426263424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708620.543718:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789708620.544142:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143fb2aa00 x1876645426263424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708636 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708620.544159:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426263424:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789708620.544167:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1435cc4e00 x1876645426263040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708620.544331:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426263040:0@lo:400:kworker.0 00000100:00100000:1.0:1789708620.545071:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789708620.545082:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426263296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708620.545143:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426263296:12345-0@lo:400:kworker.0 Request processed in 63us (2197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708620.545149:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789708620.545165:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1435cc4a80 x1876645426263296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708620.545170:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789708620.545178:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876645426263168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708620.545221:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876645426263168:12345-0@lo:400:kworker.0 Request processed in 33us (2353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708620.545227:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789708620.545241:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789708620.545255:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426262784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708620.545285:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426262784:12345-0@lo:400:kworker.0 Request processed in 31us (2378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708620.545291:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789708620.545300:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426263296:0@lo:400:kworker.0 00000100:00080000:1.0:1789708620.545326:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789708620.545331:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708620.545437:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876645426263168:0@lo:400:kworker.0 00000100:00100000:2.0:1789708620.545455:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426262784:0@lo:400:kworker.0 00000100:00100000:0.0:1789708620.545883:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789708620.545893:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426262912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708620.545948:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426262912:12345-0@lo:400:kworker.0 Request processed in 58us (2892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708620.545954:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789708620.546063:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426262912:0@lo:400:kworker.0 00000020:00000080:1.0:1789708620.742618:0:8489:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca4511af0 20000000:00000080:1.0:1789708620.742631:0:8489:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a143e9e3800 uarg=0000000000000000 20000000:01000000:1.0:1789708620.742736:0:8489:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789708620.742741:0:8489:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789708620.742753:0:8489:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789708620.747356:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789708620.747551:0:8489:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789708620.751850:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789708620.751910:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789708620.752045:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789708620.752070:0:8489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789708620.752089:0:8489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866159 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708620.752106:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1401690200/0xa8f741d1c6865ece lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865ec7 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708620.752113:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1403b6a000/0xa8f741d1c6865f30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865f29 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708620.752119:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865ffb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6865ff4 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708620.752129:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a143fa38600/0xa8f741d1c68660b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d471a expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708620.752148:0:8489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866159 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708620.752186:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a143fa38600/0xa8f741d1c68660b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d471a expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708620.752201:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a143fa38600/0xa8f741d1c68660b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d471a expref: 9 pid: 5814 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708620.752215:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1876645426263552:192.168.202.53@tcp:104: 00010000:00010000:1.0:1789708620.752315:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865ffb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6865ff4 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708620.752324:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865ffb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6865ff4 expref: 18 pid: 5813 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708620.752333:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1876645426263680:0@lo:104: 00000100:00100000:1.0:1789708620.752372:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708620.752405:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1403b6a000/0xa8f741d1c6865f30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6865f29 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708620.752413:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1403b6a000/0xa8f741d1c6865f30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6865f29 expref: 18 pid: 5814 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708620.752421:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1876645426263808:0@lo:104: 00000100:00100000:1.0:1789708620.752443:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789708620.752464:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1401690200/0xa8f741d1c6865ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6865ec7 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708620.752484:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1401690200/0xa8f741d1c6865ece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6865ec7 expref: 18 pid: 5813 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708620.752492:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1876645426263936:0@lo:104: 00000100:00100000:1.0:1789708620.752515:0:8489:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140355de40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708620.752821:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789708620.752840:0:5803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708620.752851:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426263680 00000100:00100000:0.0:1789708620.752863:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426263680 00000100:00100000:0.0:1789708620.752901:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426263808 00000100:00100000:0.0:1789708620.752905:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426263808 00000100:00100000:0.0:1789708620.752916:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426263936 00000100:00100000:0.0:1789708620.752918:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426263936 00000100:00100000:0.0:1789708620.752931:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789708620.752954:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+5:8489:x1876645426263680:12345-0@lo:104: 00010000:00010000:0.0:1789708620.752966:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a14013a1c00/0xa8f741d1c6865ff4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865ffb expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708620.753127:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789708620.753133:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+5:8489:x1876645426263680:12345-0@lo:104: Request processed in 182us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708620.753140:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789708620.753157:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789708620.753164:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f21c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+4:8489:x1876645426263808:12345-0@lo:104: 00010000:00010000:0.0:1789708620.753172:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1401690000/0xa8f741d1c6865f29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865f30 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708620.753207:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789708620.753212:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f21c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+4:8489:x1876645426263808:12345-0@lo:104: Request processed in 50us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708620.753219:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789708620.753254:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789708620.753262:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:8489:x1876645426263936:12345-0@lo:104: 00010000:00010000:0.0:1789708620.753270:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1401691c00/0xa8f741d1c6865ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865ece expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708620.753305:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789708620.753314:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:8489:x1876645426263936:12345-0@lo:104: Request processed in 54us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708620.753320:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789708620.753339:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789708620.753345:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a14013a1c00/0xa8f741d1c6865ff4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865ffb expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708620.753352:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14013a1c00 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:0.0:1789708620.753355:0:5807:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a14013a1c00/0xa8f741d1c6865ff4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6865ffb expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708620.753363:0:5807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a14013a1c00/0xa8f741d1c6865ff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6865ffb expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708620.753370:0:5807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a14013a1c00/0xa8f741d1c6865ff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6865ffb expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708620.753376:0:5807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789708620.753405:0:5807:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a14013a1c00/0xa8f741d1c6865ff4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865ffb expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708620.753411:0:5807:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708620.753430:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a14013a1c00/0xa8f741d1c6865ff4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865ffb expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708620.753437:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a14013a1c00/0xa8f741d1c6865ff4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865ffb expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708620.753450:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708620.753454:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1401690000/0xa8f741d1c6865f29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865f30 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708620.753469:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1401690000 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:0.0:1789708620.753472:0:5807:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1401690000/0xa8f741d1c6865f29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6865f30 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708620.753478:0:5807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1401690000/0xa8f741d1c6865f29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6865f30 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708620.753485:0:5807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1401690000/0xa8f741d1c6865f29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6865f30 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708620.753490:0:5807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789708620.753504:0:5807:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1401690000/0xa8f741d1c6865f29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865f30 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708620.753510:0:5807:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708620.753525:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1401690000/0xa8f741d1c6865f29 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865f30 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708620.753532:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1401690000/0xa8f741d1c6865f29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865f30 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708620.753541:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708620.753545:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1401691c00/0xa8f741d1c6865ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6865ece expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708620.753550:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1401691c00 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:0.0:1789708620.753553:0:5807:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1401691c00/0xa8f741d1c6865ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6865ece expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708620.753569:0:5807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1401691c00/0xa8f741d1c6865ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6865ece expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708620.753575:0:5807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1401691c00/0xa8f741d1c6865ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6865ece expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708620.753580:0:5807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789708620.753593:0:5807:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1401691c00/0xa8f741d1c6865ec7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865ece expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708620.753599:0:5807:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708620.753605:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1401691c00/0xa8f741d1c6865ec7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865ece expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708620.753610:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1401691c00/0xa8f741d1c6865ec7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6865ece expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708620.753623:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708620.753624:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708620.753626:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708620.753640:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789708620.753681:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426264064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708620.753709:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708620.753739:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426264192:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708620.754295:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708620.754349:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708620.754413:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708620.754419:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426264320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708620.754438:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708620.754856:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708620.754973:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1876645426263680:0@lo:104: 00000100:00100000:1.0:1789708620.754994:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1876645426263808:0@lo:104: 00000100:00100000:1.0:1789708620.755003:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1876645426263936:0@lo:104: 00000100:00100000:2.0:1789708620.755488:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426264064 00000100:00100000:2.0:1789708620.755495:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426264064 00010000:00010000:2.0:1789708620.755529:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865ffb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865ff4 expref: 19 pid: 5813 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708620.755555:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426264192 00000100:00100000:2.0:1789708620.755559:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426264192 00010000:00010000:2.0:1789708620.755571:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1403b6a000/0xa8f741d1c6865f30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865f29 expref: 20 pid: 5814 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708620.755594:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426264320 00000100:00100000:2.0:1789708620.755597:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426264320 00010000:00010000:2.0:1789708620.755608:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1401690200/0xa8f741d1c6865ece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865ec7 expref: 21 pid: 5813 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708620.755620:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789708620.755627:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+21:3286:x1876645426264064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708620.755638:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708620.755643:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865ffb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865ff4 expref: 21 pid: 5813 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.755684:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865ffb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6865ff4 expref: 21 pid: 5813 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.755700:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1401691a00/0xa8f741d1c6865ffb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6865ff4 expref: 21 pid: 5813 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.755713:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708620.755763:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+20:3286:x1876645426264064:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708620.755770:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789708620.755785:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789708620.755791:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3288:x1876645426264192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708620.755799:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708620.755803:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1403b6a000/0xa8f741d1c6865f30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865f29 expref: 19 pid: 5814 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.755810:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1403b6a000/0xa8f741d1c6865f30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6865f29 expref: 19 pid: 5814 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.755825:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1403b6a000/0xa8f741d1c6865f30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6865f29 expref: 19 pid: 5814 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.755833:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708620.755858:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:3288:x1876645426264192:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708620.755863:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789708620.755874:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789708620.755880:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:3288:x1876645426264320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708620.755887:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708620.755890:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1401690200/0xa8f741d1c6865ece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6865ec7 expref: 17 pid: 5813 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.755897:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1401690200/0xa8f741d1c6865ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6865ec7 expref: 17 pid: 5813 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.755906:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1401690200/0xa8f741d1c6865ece lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6865ec7 expref: 17 pid: 5813 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.755915:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708620.755932:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:3288:x1876645426264320:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708620.755949:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789708620.756074:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426264064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708620.756099:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426264320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708620.756106:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426264192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708620.756222:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1876645426263552:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708620.756243:0:8489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866159 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708620.758590:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708620.758677:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415752960 00000100:00100000:2.0:1789708620.758692:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415752960 00010000:00010000:2.0:1789708620.758720:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a143fa38600/0xa8f741d1c68660b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d471a expref: 10 pid: 5814 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708620.758763:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:2.0:1789708620.758772:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2362:x1876645415752960:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708620.758786:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708620.758792:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a143fa38600/0xa8f741d1c68660b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d471a expref: 10 pid: 5814 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.758802:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a143fa38600/0xa8f741d1c68660b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d471a expref: 10 pid: 5814 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.758818:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa38600/0xa8f741d1c68660b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d471a expref: 10 pid: 5814 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.758833:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866159 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.758841:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866159 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.758859:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866159 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.758865:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866159 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.758872:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866159 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.758889:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866159 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.758895:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14013a0200 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:2.0:1789708620.758899:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866159 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.758907:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866159 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.758924:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866159 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.758934:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708620.759051:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:2362:x1876645415752960:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 279us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708620.759059:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 24 00010000:00010000:1.0:1789708620.759236:0:8489:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866159 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708620.759245:0:8489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866159 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708620.759252:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866159 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708620.923073:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789708621.010804:0:5816:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789708621.010812:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1302f7e800 from 4 10000000:01000000:0.0:1789708621.010817:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789708621.010868:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c6866160 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708621.010881:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c6866160 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708621.010892:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c6866160 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708621.010917:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426264448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708621.010982:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708621.011046:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a142d9d4480 going to sleep for 11 seconds 00000100:00100000:1.0:1789708621.011321:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426264448 00000100:00100000:1.0:1789708621.011330:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426264448 00000100:00100000:1.0:1789708621.011388:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789708621.011395:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:5816:x1876645426264448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708621.011406:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708621.011417:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866167 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6866160 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708621.011435:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6866160 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708621.011453:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6866160 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708621.011459:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14013a0200, rc 0) 00000100:00100000:1.0:1789708621.011504:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426264448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708621.011511:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789708621.013343:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426264448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708621.013365:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c6866160 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866167 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708621.013376:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c6866160 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6866167 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708621.013447:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426264576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708621.013486:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708621.013529:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1306c82480 going to sleep for 11 seconds 00000100:00100000:2.0:1789708621.015831:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426264576 00000100:00100000:2.0:1789708621.015842:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426264576 00000100:00100000:2.0:1789708621.015910:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789708621.015919:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426264576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708621.016211:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426264576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (2724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708621.016219:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789708621.016421:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426264576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708621.016483:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426264704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708621.016528:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708621.016565:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1306c82480 going to sleep for 11 seconds 00000100:00100000:2.0:1789708621.016618:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426264704 00000100:00100000:2.0:1789708621.016623:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426264704 00000100:00100000:2.0:1789708621.016695:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789708621.016710:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426264704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708621.016880:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426264704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708621.016886:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789708621.017076:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426264704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708621.017514:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8502:1876645426264832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708621.017549:0:8502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708621.017578:0:8502:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14051bb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708621.017625:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426264832 00000100:00100000:2.0:1789708621.017630:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426264832 00000100:00100000:2.0:1789708621.017681:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789708621.017688:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:8502:x1876645426264832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708621.017901:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:8502:x1876645426264832:12345-0@lo:502:llog_process_th.0 Request processed in 213us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708621.017908:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789708621.019847:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8502:1876645426264832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789708621.019891:0:8502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708621.019902:0:8502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708621.019905:0:8502:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789708621.019913:0:8502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1302f7e800 00000020:00000080:1.0:1789708621.019915:0:8502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789708621.020004:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8502:1876645426264960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708621.020063:0:8502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708621.020103:0:8502:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14051bb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708621.021216:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426264960 00000100:00100000:0.0:1789708621.021222:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426264960 00000100:00100000:0.0:1789708621.021267:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789708621.021276:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:8502:x1876645426264960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708621.021480:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:8502:x1876645426264960:12345-0@lo:502:llog_process_th.0 Request processed in 204us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708621.021488:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789708621.021695:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8502:1876645426264960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789708621.021723:0:8502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708621.021730:0:8502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708621.021732:0:8502:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789708621.021737:0:8502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789708621.022001:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789708621.022027:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789708621.022035:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c6866160 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866167 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708621.022043:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c6866160 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866167 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708621.022051:0:5816:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789708621.022053:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a143fa6b000 from 4 10000000:01000000:0.0:1789708621.022054:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789708621.022074:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c686616e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708621.022080:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c686616e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708621.022086:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c686616e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708621.022098:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426265088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708621.022121:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708621.023055:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a142d9d4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708621.023626:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426265088 00000100:00100000:3.0:1789708621.023635:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426265088 00000100:00100000:3.0:1789708621.023896:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789708621.023906:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426265088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708621.023921:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708621.023946:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa38800/0xa8f741d1c6866175 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c686616e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708621.023973:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa38800/0xa8f741d1c6866175 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c686616e expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708621.023984:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa38800/0xa8f741d1c6866175 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686616e expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708621.024002:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38800, rc 0) 00000100:00100000:3.0:1789708621.024061:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426265088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708621.024068:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789708621.024145:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426265088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708621.024160:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c686616e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866175 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708621.024168:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c686616e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6866175 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708621.024224:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426265216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708621.024257:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708621.024488:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a142d9d4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708621.024517:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426265216 00000100:00100000:2.0:1789708621.024522:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426265216 00000100:00100000:2.0:1789708621.024542:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789708621.024548:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426265216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708621.024806:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426265216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708621.024814:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789708621.025083:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426265216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708621.025121:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426265344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708621.025159:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708621.025188:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a142d9d4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708621.025239:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426265344 00000100:00100000:3.0:1789708621.025245:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426265344 00000100:00100000:3.0:1789708621.025276:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789708621.025282:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426265344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708621.025431:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426265344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708621.025437:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789708621.025577:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426265344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708621.025790:0:8505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8505:1876645426265472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708621.025824:0:8505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708621.025835:0:8505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1306c82300 going to sleep for 11 seconds 00000100:00100000:0.0:1789708621.025889:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426265472 00000100:00100000:0.0:1789708621.025895:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426265472 00000100:00100000:0.0:1789708621.025929:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789708621.025945:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:8505:x1876645426265472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708621.026079:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:8505:x1876645426265472:12345-0@lo:502:llog_process_th.0 Request processed in 144us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708621.026086:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789708621.026234:0:8505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8505:1876645426265472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789708621.026261:0:8505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708621.026269:0:8505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708621.026272:0:8505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789708621.026279:0:8505:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a143fa6b000 00000020:00000080:3.0:1789708621.026281:0:8505:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789708621.026353:0:8505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8505:1876645426265600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708621.026399:0:8505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708621.026418:0:8505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1306c82300 going to sleep for 11 seconds 00000100:00100000:0.0:1789708621.026671:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426265600 00000100:00100000:0.0:1789708621.026676:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426265600 00000100:00100000:0.0:1789708621.026702:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789708621.026708:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:8505:x1876645426265600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708621.026845:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:8505:x1876645426265600:12345-0@lo:502:llog_process_th.0 Request processed in 137us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708621.026852:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789708621.027038:0:8505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8505:1876645426265600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789708621.027060:0:8505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708621.027065:0:8505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708621.027066:0:8505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789708621.027070:0:8505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789708621.027127:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789708621.027153:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708621.027162:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c686616e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866175 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708621.027172:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c686616e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866175 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708621.027183:0:5816:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789708621.027186:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1410604800 from 4 10000000:01000000:3.0:1789708621.027189:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708621.027209:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38200/0xa8f741d1c686617c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708621.027217:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143fa38200/0xa8f741d1c686617c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708621.027227:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143fa38200/0xa8f741d1c686617c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708621.027239:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426265728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708621.027268:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708621.027282:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1306c82300 going to sleep for 11 seconds 00000100:00100000:3.0:1789708621.027294:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426265728 00000100:00100000:3.0:1789708621.027298:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426265728 00000100:00100000:3.0:1789708621.027325:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789708621.027331:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426265728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708621.027339:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708621.027350:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa39c00/0xa8f741d1c6866183 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c686617c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708621.027445:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa39c00/0xa8f741d1c6866183 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c686617c expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708621.027456:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa39c00/0xa8f741d1c6866183 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686617c expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708621.027559:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39c00, rc 0) 00000100:00100000:3.0:1789708621.027590:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426265728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 259us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708621.027597:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789708621.027625:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426265728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708621.027636:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143fa38200/0xa8f741d1c686617c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866183 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708621.027645:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38200/0xa8f741d1c686617c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6866183 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708621.027700:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426265856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708621.027724:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708621.027737:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1306c82300 going to sleep for 11 seconds 00000100:00100000:3.0:1789708621.027759:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426265856 00000100:00100000:3.0:1789708621.027763:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426265856 00000100:00100000:3.0:1789708621.027789:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789708621.027795:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426265856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708621.028914:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426265856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1116us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708621.028923:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789708621.029273:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426265856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708621.029323:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426265984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708621.029364:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708621.029910:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4b000 going to sleep for 11 seconds 00000100:00100000:0.0:1789708621.030099:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426265984 00000100:00100000:0.0:1789708621.030106:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426265984 00000100:00100000:0.0:1789708621.030151:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789708621.030160:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426265984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708621.030346:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426265984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708621.030358:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789708621.030570:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426265984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708621.030836:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8506:1876645426266112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708621.030879:0:8506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708621.030901:0:8506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708621.031039:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426266112 00000100:00100000:3.0:1789708621.031044:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426266112 00000100:00100000:3.0:1789708621.031107:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789708621.031116:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:8506:x1876645426266112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708621.031264:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:8506:x1876645426266112:12345-0@lo:502:llog_process_th.0 Request processed in 149us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708621.031270:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789708621.031321:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8506:1876645426266112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708621.031341:0:8506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708621.031349:0:8506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708621.031351:0:8506:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789708621.031359:0:8506:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1410604800 00000020:00000080:2.0:1789708621.031362:0:8506:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789708621.031865:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8506:1876645426266240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708621.031906:0:8506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708621.031985:0:8506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14050ce840 going to sleep for 11 seconds 00000100:00100000:3.0:1789708621.032095:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426266240 00000100:00100000:3.0:1789708621.032100:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426266240 00000100:00100000:3.0:1789708621.032132:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789708621.032138:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:8506:x1876645426266240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708621.032270:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:8506:x1876645426266240:12345-0@lo:502:llog_process_th.0 Request processed in 132us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708621.032277:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789708621.032357:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308528a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:8506:1876645426266240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708621.032449:0:8506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708621.032454:0:8506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708621.032456:0:8506:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789708621.032552:0:8506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789708621.032609:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789708621.032632:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789708621.032641:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38200/0xa8f741d1c686617c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866183 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708621.032674:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa38200/0xa8f741d1c686617c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866183 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708621.257206:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708621.257266:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415753088 00000100:00100000:3.0:1789708621.257275:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415753088 00000100:00100000:3.0:1789708621.257357:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 181 00000100:00100000:3.0:1789708621.257365:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:5595:x1876645415753088:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708621.257379:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708621.257392:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa38000/0xa8f741d1c686618a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4759 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708621.257426:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa38000/0xa8f741d1c686618a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4759 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708621.257433:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa38000/0xa8f741d1c686618a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4759 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708621.257440:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38000, rc 0) 00000100:00100000:3.0:1789708621.257495:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:5595:x1876645415753088:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 131us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708621.257499:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 181 00000100:00100000:2.0:1789708621.271945:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708621.271999:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415753216 00000100:00100000:3.0:1789708621.272007:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415753216 00000100:00100000:3.0:1789708621.272063:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 182 00000100:00100000:3.0:1789708621.272073:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:5595:x1876645415753216:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708621.272351:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:5595:x1876645415753216:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 278us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708621.272360:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 182 00000100:00100000:1.0:1789708621.281032:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708621.281096:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415753344 00000100:00100000:2.0:1789708621.281105:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415753344 00000100:00100000:2.0:1789708621.281160:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 183 00000100:00100000:2.0:1789708621.281167:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:5595:x1876645415753344:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708621.281409:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:5595:x1876645415753344:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 Request processed in 241us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708621.281415:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 183 00000100:00100000:2.0:1789708621.288094:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708621.288135:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415753472 00000100:00100000:0.0:1789708621.288146:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415753472 00000100:00100000:0.0:1789708621.288240:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 184 00000100:00100000:0.0:1789708621.288251:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:6123:x1876645415753472:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789708621.288556:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:6123:x1876645415753472:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 306us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708621.288564:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 184 00000100:00100000:0.0:1789708621.291932:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708621.292032:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415753600 00000100:00100000:2.0:1789708621.292041:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415753600 00000100:00100000:2.0:1789708621.292097:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 185 00000100:00100000:2.0:1789708621.292109:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:6123:x1876645415753600:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789708621.292486:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:6123:x1876645415753600:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 379us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708621.292497:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 185 00010000:00010000:2.0:1789708621.947327:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708622.971259:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708623.102265:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708623.102318:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708623.102353:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708623.102379:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708623.102408:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415753856 00000100:00100000:1.0:1789708623.102418:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415753856 00000100:00100000:1.0:1789708623.102469:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:1.0:1789708623.102477:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415753856:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708623.102535:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415753856:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 60us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708623.102540:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:1.0:1789708623.102557:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415753984 00000100:00100000:1.0:1789708623.102560:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415753984 00000100:00100000:1.0:1789708623.102574:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415754112 00000100:00100000:1.0:1789708623.102575:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415754112 00000100:00100000:1.0:1789708623.102584:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:1.0:1789708623.102588:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2361:x1876645415753984:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708623.102604:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2361:x1876645415753984:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 16us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708623.102608:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:1.0:1789708623.102614:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:1.0:1789708623.102617:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2361:x1876645415754112:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708623.102629:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2361:x1876645415754112:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 12us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708623.102633:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00080000:1.0:1789708623.102642:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789708623.102645:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789708623.102673:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708623.102845:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415753728 00000100:00100000:0.0:1789708623.102850:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415753728 00000100:00100000:0.0:1789708623.102875:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 186 00000100:00100000:0.0:1789708623.102882:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2361:x1876645415753728:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708623.102915:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2361:x1876645415753728:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 33us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708623.102921:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 186 00010000:00010000:3.0:1789708623.995787:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789708624.971907:0:8787:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1789708625.023088:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708625.146948:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426266368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708625.147019:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708625.147111:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426266368 00000100:00100000:2.0:1789708625.147119:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426266368 00000100:00100000:2.0:1789708625.147181:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789708625.147190:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426266368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789708625.147232:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789708625.147500:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426266368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 310us (480us total) trans 0 rc 0/0 00000100:00080000:1.0:1789708625.147502:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708625.147511:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789708625.147575:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14037b8000 x1876645426266368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708641 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708625.147593:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426266368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789708625.658866:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789708625.658950:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426266496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708625.659241:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708625.659838:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426266624:0@lo:400:kworker.0 00000100:00100000:1.0:1789708625.659876:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708625.659928:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426266624 00000100:00100000:2.0:1789708625.659935:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426266624 00000100:00100000:1.0:1789708625.659950:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789708625.659957:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426266752:0@lo:400:kworker.0 00000100:00100000:1.0:1789708625.659984:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708625.660011:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426266752 00000100:00100000:1.0:1789708625.660015:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426266752 00000100:00100000:1.0:1789708625.660058:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789708625.660067:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426266752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708625.660116:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426266752:12345-0@lo:400:kworker.0 Request processed in 50us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708625.660123:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789708625.660162:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426266752:0@lo:400:kworker.0 00000100:00100000:2.0:1789708625.660235:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789708625.660244:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3288:x1876645426266624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708625.660388:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3288:x1876645426266624:12345-0@lo:400:kworker.0 Request processed in 145us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708625.660396:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789708625.660499:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426266624:0@lo:400:kworker.0 00000100:00100000:3.0:1789708625.660587:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426266496 00000100:00100000:3.0:1789708625.660593:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426266496 00000100:00100000:3.0:1789708625.660636:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789708625.660643:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426266496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789708625.660684:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708625.660738:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426266496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (1498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708625.660751:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789708625.660768:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789708625.660789:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14037ba680 x1876645426266496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708641 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708625.660805:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426266496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708625.661826:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426267008:0@lo:400:kworker.0 00000100:00100000:0.0:1789708625.661864:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708625.661899:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789708625.661905:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426266880:0@lo:400:kworker.0 00000100:00100000:0.0:1789708625.661929:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708625.661956:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426267008 00000100:00100000:0.0:1789708625.661961:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426267008 00000100:00100000:0.0:1789708625.661994:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708625.662002:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426267008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708625.662042:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426267008:12345-0@lo:400:kworker.0 Request processed in 42us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708625.662048:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708625.662065:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426266880 00000100:00100000:0.0:1789708625.662068:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426266880 00000100:00100000:0.0:1789708625.662094:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789708625.662100:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426266880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708625.662130:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426266880:12345-0@lo:400:kworker.0 Request processed in 30us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708625.662135:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789708625.662164:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426266880:0@lo:400:kworker.0 00010000:00080000:0.0:1789708625.662174:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143fb29180 x1876645426267008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708625.662184:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426267008:0@lo:400:kworker.0 00000100:00100000:0.0:1789708625.662216:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789708625.662223:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426267136:0@lo:400:kworker.0 00000100:00100000:0.0:1789708625.662247:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708625.662270:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426267136 00000100:00080000:3.0:1789708625.662274:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708625.662274:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426267136 00000100:00100000:0.0:1789708625.662304:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789708625.662310:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426267136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708625.662343:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426267136:12345-0@lo:400:kworker.0 Request processed in 33us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708625.662349:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789708625.662374:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426267136:0@lo:400:kworker.0 00010000:00010000:0.0:1789708626.043048:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708627.067826:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789708628.027737:0:9031:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing yml_node 00010000:00010000:2.0:1789708628.094328:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708628.218760:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708628.218801:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708628.218836:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708628.218844:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415754624 00000100:00100000:3.0:1789708628.218855:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415754624 00000100:00100000:1.0:1789708628.218861:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708628.218879:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415754240 00000100:00100000:1.0:1789708628.218882:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415754240 00000100:00100000:3.0:1789708628.218906:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415754496 00000100:00100000:3.0:1789708628.218909:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415754496 00000100:00100000:1.0:1789708628.218910:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 188 00000100:00100000:1.0:1789708628.218920:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2363:x1876645415754240:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708628.218923:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:3.0:1789708628.218929:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2363:x1876645415754624:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708628.218991:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2363:x1876645415754624:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 60us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708628.218991:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2363:x1876645415754240:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 71us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708628.218998:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:1.0:1789708628.219002:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 188 00000100:00100000:3.0:1789708628.219014:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:3.0:1789708628.219019:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2363:x1876645415754496:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708628.219044:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2363:x1876645415754496:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708628.219049:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00080000:3.0:1789708628.219063:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789708628.219066:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708628.219264:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415754368 00000100:00100000:2.0:1789708628.219269:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415754368 00000100:00100000:2.0:1789708628.219350:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:2.0:1789708628.219358:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2363:x1876645415754368:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708628.219393:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2363:x1876645415754368:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 36us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708628.219400:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00080000:3.0:1789708628.220804:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789708629.118974:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708630.138757:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708630.267072:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426267264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708630.267143:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708630.267855:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426267264 00000100:00100000:3.0:1789708630.267864:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426267264 00000100:00100000:3.0:1789708630.267927:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789708630.267937:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426267264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789708630.267975:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708630.268031:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426267264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708630.268040:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1789708630.268065:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789708630.268098:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14037ba680 x1876645426267264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708646 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708630.268118:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426267264:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789708630.360974:0:9223:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00000100:00100000:0.0:1789708630.780032:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426267392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708630.780136:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708630.780323:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426267392 00000100:00100000:0.0:1789708630.780331:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426267392 00000100:00100000:0.0:1789708630.780379:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789708630.780392:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426267392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789708630.780422:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789708630.780468:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426267392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708630.780476:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789708630.780496:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789708630.780525:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143fb28700 x1876645426267392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708646 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708630.780544:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426267392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708630.782073:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130852b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426267648:0@lo:400:kworker.0 00000100:00100000:1.0:1789708630.782077:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130852ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876645426267904:0@lo:400:kworker.0 00000100:00100000:0.0:1789708630.782162:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426267520:0@lo:400:kworker.0 00000100:00100000:1.0:1789708630.782183:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708630.782194:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708630.782237:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426267904 00000100:00100000:0.0:1789708630.782238:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426267520 00000100:00100000:1.0:1789708630.782243:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426267904 00000100:00100000:0.0:1789708630.782243:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426267520 00000100:00100000:0.0:1789708630.782282:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789708630.782291:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3287:x1876645426267520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708630.782332:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3287:x1876645426267520:12345-0@lo:400:kworker.0 Request processed in 42us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708630.782339:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789708630.782344:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789708630.782350:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876645426267904:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789708630.782371:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708630.782386:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876645426267904:12345-0@lo:400:kworker.0 Request processed in 37us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708630.782390:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426267520:0@lo:400:kworker.0 00000100:00100000:1.0:1789708630.782392:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789708630.782417:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130852ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876645426267904:0@lo:400:kworker.0 00000100:00100000:2.0:1789708630.782676:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708630.782698:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789708630.782703:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130852aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426267776:0@lo:400:kworker.0 00000100:00100000:2.0:1789708630.782724:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708630.784127:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426267648 00000100:00100000:0.0:1789708630.784136:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426267648 00000100:00100000:0.0:1789708630.784217:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426267776 00000100:00100000:0.0:1789708630.784221:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426267776 00000100:00100000:0.0:1789708630.784253:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789708630.784262:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426267648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708630.784327:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426267648:12345-0@lo:400:kworker.0 Request processed in 67us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708630.784334:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789708630.784348:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789708630.784355:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426267776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708630.784384:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426267776:12345-0@lo:400:kworker.0 Request processed in 30us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708630.784390:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789708630.784406:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708630.784435:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130852aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426267776:0@lo:400:kworker.0 00000100:00100000:0.0:1789708630.784444:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130852b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426267648:0@lo:400:kworker.0 00010000:00010000:2.0:1789708631.164406:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789708631.866588:0:9320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:0.0:1789708632.193738:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708633.210892:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708633.341890:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708633.341930:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708633.341960:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708633.341999:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708633.342025:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415754880 00000100:00100000:1.0:1789708633.342032:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415754880 00000100:00100000:1.0:1789708633.342085:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:1.0:1789708633.342096:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415754880:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708633.342162:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415754880:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 68us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708633.342170:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:1.0:1789708633.342194:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415755008 00000100:00100000:1.0:1789708633.342198:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415755008 00000100:00100000:1.0:1789708633.342221:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415755136 00000100:00100000:1.0:1789708633.342231:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415755136 00000100:00100000:1.0:1789708633.342251:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:1.0:1789708633.342257:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2361:x1876645415755008:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708633.342284:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2361:x1876645415755008:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 27us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708633.342291:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:1.0:1789708633.342302:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:1.0:1789708633.342308:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2361:x1876645415755136:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708633.342333:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2361:x1876645415755136:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708633.342339:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00080000:1.0:1789708633.342354:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789708633.342358:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789708633.342360:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708633.342504:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415754752 00000100:00100000:2.0:1789708633.342508:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415754752 00000100:00100000:2.0:1789708633.342542:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 190 00000100:00100000:2.0:1789708633.342554:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2361:x1876645415754752:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708633.342599:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2361:x1876645415754752:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 45us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708633.342605:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 190 00000001:02000400:3.0:1789708633.499303:0:9417:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:0.0:1789708634.236961:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789708634.472956:0:9465:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 18 01:17:14 EDT 2026 00010000:00010000:2.0:1789708635.260127:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708635.387407:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789708635.387427:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426268032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708635.387489:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708635.388037:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426268032 00000100:00100000:0.0:1789708635.388045:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426268032 00000100:00100000:0.0:1789708635.388170:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789708635.388185:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426268032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789708635.388220:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789708635.388270:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426268032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708635.388278:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789708635.388299:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789708635.388343:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14037ba680 x1876645426268032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708651 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708635.388362:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426268032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708635.898951:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143ec30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426268160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708635.899095:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426268288:0@lo:400:kworker.0 00000100:00100000:2.0:1789708635.899429:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708635.899503:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426268800:0@lo:400:kworker.0 00000100:00100000:2.0:1789708635.899544:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708635.899567:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789708635.899573:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426268672:0@lo:400:kworker.0 00000100:00100000:3.0:1789708635.899592:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426268288 00000100:00100000:2.0:1789708635.899611:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708635.899614:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426268288 00000100:00100000:2.0:1789708635.899641:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426268800 00000100:00100000:2.0:1789708635.899646:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426268800 00000100:00100000:3.0:1789708635.899721:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789708635.899726:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789708635.899739:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130852a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426268800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708635.899869:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140309fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426268288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708635.899929:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140309fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426268288:12345-0@lo:400:kworker.0 Request processed in 198us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708635.899938:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789708635.900054:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130852a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426268800:12345-0@lo:400:kworker.0 Request processed in 319us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708635.900062:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789708635.900084:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426268672 00000100:00100000:2.0:1789708635.900089:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426268672 00000100:00100000:2.0:1789708635.900125:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789708635.900131:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130852b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426268672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708635.900273:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130852b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426268672:12345-0@lo:400:kworker.0 Request processed in 141us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708635.900289:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789708635.900310:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789708635.900316:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789708635.900322:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708635.900414:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426268672:0@lo:400:kworker.0 00010000:00080000:2.0:1789708635.900433:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14037b8000 x1876645426268800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708635.900445:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426268800:0@lo:400:kworker.0 00000100:00100000:2.0:1789708635.900453:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426268288:0@lo:400:kworker.0 00000100:00100000:1.0:1789708635.901199:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426268416:0@lo:400:kworker.0 00000100:00100000:1.0:1789708635.901262:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708635.901295:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708635.901304:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426268544:0@lo:400:kworker.0 00000100:00100000:1.0:1789708635.901330:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708635.901370:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426268416 00000100:00100000:1.0:1789708635.901376:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426268416 00000100:00100000:1.0:1789708635.901410:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426268544 00000100:00100000:1.0:1789708635.901413:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426268544 00000100:00100000:1.0:1789708635.901443:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789708635.901451:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426268416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708635.901499:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426268416:12345-0@lo:400:kworker.0 Request processed in 48us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708635.901512:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789708635.901528:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789708635.901534:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426268544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708635.901563:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426268544:12345-0@lo:400:kworker.0 Request processed in 30us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708635.901569:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789708635.901591:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708635.901629:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426268544:0@lo:400:kworker.0 00000100:00100000:1.0:1789708635.901641:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426268416:0@lo:400:kworker.0 00000100:00100000:3.0:1789708635.902269:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426268160 00000100:00100000:3.0:1789708635.902276:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426268160 00000100:00100000:3.0:1789708635.902321:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789708635.902329:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426268160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789708635.902369:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708635.902432:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426268160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (2111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708635.902441:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789708635.902464:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143ec30000 x1876645426268160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708651 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708635.902484:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143ec30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426268160:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789708636.285913:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708637.307796:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708638.340944:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708638.459788:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708638.459833:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708638.459906:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415755264 00000100:00100000:0.0:1789708638.459917:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415755264 00000100:00100000:0.0:1789708638.459972:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 192 00000100:00100000:0.0:1789708638.459984:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2361:x1876645415755264:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708638.460060:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2361:x1876645415755264:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 79us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708638.460068:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 192 00000100:00100000:1.0:1789708638.460535:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415755392 00000100:00100000:1.0:1789708638.460541:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415755392 00000100:00100000:1.0:1789708638.460599:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:1.0:1789708638.460607:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130852b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415755392:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708638.460640:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130852b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415755392:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 34us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708638.460647:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00080000:3.0:1789708638.460716:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708638.462234:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708638.462279:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415755520 00000100:00100000:0.0:1789708638.462295:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415755520 00000100:00100000:0.0:1789708638.462373:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:0.0:1789708638.462387:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130852aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2360:x1876645415755520:12345-192.168.202.53@tcp:9:kworker.0 00000020:00000080:0.0:1789708638.462420:0:6673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c68660c6 00000100:00080000:0.0:1789708638.462429:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8a140318f800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1789708638.462481:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:0.0:1789708638.462633:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789708638.462690:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708638.463103:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130852aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+2:2360:x1876645415755520:12345-192.168.202.53@tcp:9:kworker.0 Request processed in 720us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708638.463114:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:0.0:1789708638.463132:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415755648 00000100:00100000:0.0:1789708638.463135:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415755648 00000100:00100000:0.0:1789708638.463163:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:0.0:1789708638.463171:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130852ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2360:x1876645415755648:12345-192.168.202.53@tcp:9:kworker.0 00000020:00000080:0.0:1789708638.463188:0:6673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c68660cd 00000100:00080000:0.0:1789708638.463195:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8a140318c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789708638.463217:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789708638.463455:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130852ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+2:2360:x1876645415755648:12345-192.168.202.53@tcp:9:kworker.0 Request processed in 284us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708638.463465:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00010000:00010000:0.0:1789708638.463536:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708638.463541:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789708638.463546:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789708639.355336:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708640.379323:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708640.507920:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789708640.507943:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426268928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708640.508013:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708640.508179:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426268928 00000100:00100000:3.0:1789708640.508187:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426268928 00000100:00100000:3.0:1789708640.508258:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789708640.508271:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426268928:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789708640.508273:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789708640.508309:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708640.508365:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426268928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708640.508373:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789708640.508433:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14037bad80 x1876645426268928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708656 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708640.508452:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426268928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708641.020234:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789708641.020260:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143ec31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426269056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708641.020333:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708641.022138:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426269056 00000100:00100000:3.0:1789708641.022150:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426269056 00000100:00100000:0.0:1789708641.022332:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143ec32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426269440:0@lo:400:kworker.0 00000100:00100000:0.0:1789708641.022418:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708641.022473:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789708641.022480:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143ec30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876645426269568:0@lo:400:kworker.0 00000100:00100000:0.0:1789708641.022504:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708641.022532:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426269440 00000100:00100000:0.0:1789708641.022536:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426269440 00000100:00100000:3.0:1789708641.022643:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789708641.022670:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426269056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789708641.022706:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708641.022756:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426269056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (2423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708641.022764:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789708641.023689:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143ec31180 x1876645426269056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708641.023713:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143ec31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426269056:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789708641.024610:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789708641.024617:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708641.024635:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143ec31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426269184:0@lo:400:kworker.0 00000100:00100000:2.0:1789708641.024707:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708641.024710:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143ec30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876645426269312:0@lo:400:kworker.0 00000100:00100000:3.0:1789708641.024739:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708641.024758:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426269184 00000100:00100000:2.0:1789708641.024764:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426269184 00000100:00100000:3.0:1789708641.024767:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426269568 00000100:00100000:3.0:1789708641.024770:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426269568 00000100:00100000:2.0:1789708641.024866:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789708641.024875:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3288:x1876645426269184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708641.024876:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426269312 00000100:00100000:3.0:1789708641.024880:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426269312 00000100:00100000:3.0:1789708641.024893:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789708641.024898:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876645426269568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708641.024931:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3288:x1876645426269184:12345-0@lo:400:kworker.0 Request processed in 58us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708641.024938:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789708641.024985:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143ec31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426269184:0@lo:400:kworker.0 00000100:00080000:2.0:1789708641.025000:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708641.025006:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876645426269568:12345-0@lo:400:kworker.0 Request processed in 108us (2501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708641.025066:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789708641.025077:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789708641.025082:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876645426269312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708641.025115:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876645426269312:12345-0@lo:400:kworker.0 Request processed in 32us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708641.025120:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789708641.025142:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143ec30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876645426269312:0@lo:400:kworker.0 00000100:00100000:3.0:1789708641.025145:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143ec30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876645426269568:0@lo:400:kworker.0 00000100:00100000:0.0:1789708641.026247:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789708641.026261:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426269440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708641.026320:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426269440:12345-0@lo:400:kworker.0 Request processed in 65us (3903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708641.026326:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789708641.026602:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143ec32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426269440:0@lo:400:kworker.0 00010000:00010000:0.0:1789708641.404904:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789708641.581682:0:7627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14bb7f14-3461-47f6-86c9-db3f545050ad 00000020:00000080:0.0:1789708641.581691:0:7627:0:(genops.c:885:class_export_put()) final put ffff8a1403189800/14bb7f14-3461-47f6-86c9-db3f545050ad 00000020:00000080:1.0:1789708641.581728:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1403189800/14bb7f14-3461-47f6-86c9-db3f545050ad for lustre-OST0001 00000020:00000080:1.0:1789708641.581781:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a140318c000 for lustre-OST0001 00000001:00100000:3.0:1789708642.063348:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 14bb7f14-3461-47f6-86c9-db3f545050ad 00000020:00000080:3.0:1789708642.063358:0:6697:0:(genops.c:885:class_export_put()) final put ffff8a140318c800/14bb7f14-3461-47f6-86c9-db3f545050ad 00000020:00000080:0.0:1789708642.063403:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a140318c800/14bb7f14-3461-47f6-86c9-db3f545050ad for lustre-OST0000 00000020:00000080:0.0:1789708642.063458:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a140318f800 for lustre-OST0000 00010000:00010000:0.0:1789708642.426921:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708643.450877:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708643.581644:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708643.581715:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708643.581847:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415755904 00000100:00100000:3.0:1789708643.581858:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415755904 00000100:00100000:3.0:1789708643.581929:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:3.0:1789708643.581941:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2363:x1876645415755904:12345-192.168.202.53@tcp:400:kworker.0 00000100:00080000:2.0:1789708643.582044:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708643.582187:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2363:x1876645415755904:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 247us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708643.582196:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:1.0:1789708643.582271:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415755776 00000100:00100000:1.0:1789708643.582282:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415755776 00000100:00100000:1.0:1789708643.582320:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 194 00000100:00100000:1.0:1789708643.582329:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2363:x1876645415755776:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708643.582358:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2363:x1876645415755776:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 31us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708643.582365:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 194 00000001:02000400:3.0:1789708644.160544:0:10096:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:17:23 (1789708643) === 00000100:00100000:2.0:1789708644.375754:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708644.375927:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415756032 00000100:00100000:0.0:1789708644.375937:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415756032 00000100:00100000:0.0:1789708644.376000:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 195 00000100:00100000:0.0:1789708644.376010:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:8122:x1876645415756032:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789708644.376031:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708644.376059:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866191 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4760 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708644.376098:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4760 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708644.376109:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4760 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708644.376143:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400031600, rc 0) 00000100:00100000:0.0:1789708644.376198:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+11:8122:x1876645415756032:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 190us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708644.376205:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 195 00000100:00100000:2.0:1789708644.384578:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708644.384644:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415756160 00000100:00100000:1.0:1789708644.384686:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415756160 00000100:00100000:1.0:1789708644.384732:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 196 00000100:00100000:1.0:1789708644.384740:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+11:8122:x1876645415756160:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789708644.385390:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+11:8122:x1876645415756160:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 648us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708644.385401:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 196 00000100:00100000:2.0:1789708644.389849:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708644.389910:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415756288 00000100:00100000:3.0:1789708644.389921:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415756288 00000100:00100000:3.0:1789708644.389988:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 197 00000100:00100000:3.0:1789708644.390006:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+11:8122:x1876645415756288:12345-192.168.202.53@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789708644.390263:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+11:8122:x1876645415756288:12345-192.168.202.53@tcp:503:mount.lustre.0 Request processed in 259us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708644.390272:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 197 00000100:00100000:2.0:1789708644.393308:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708644.393430:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415756416 00000100:00100000:1.0:1789708644.393441:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415756416 00000100:00100000:1.0:1789708644.393528:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 198 00000100:00100000:1.0:1789708644.393540:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+11:8126:x1876645415756416:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789708644.393860:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+11:8126:x1876645415756416:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 323us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708644.393869:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 198 00000100:00100000:2.0:1789708644.407768:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708644.407867:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415756544 00000100:00100000:3.0:1789708644.407876:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415756544 00000100:00100000:3.0:1789708644.407925:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 199 00000100:00100000:3.0:1789708644.407932:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+11:8126:x1876645415756544:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789708644.408239:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+11:8126:x1876645415756544:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 306us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708644.408245:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 199 00000100:00100000:2.0:1789708644.414128:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708644.414266:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415756672 00000100:00100000:0.0:1789708644.414277:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415756672 00000100:00100000:0.0:1789708644.414339:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 200 00000100:00100000:0.0:1789708644.414349:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+11:8122:x1876645415756672:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789708644.414367:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708644.414396:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400031400/0xa8f741d1c6866198 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d478a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708644.414435:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400031400/0xa8f741d1c6866198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d478a expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708644.414446:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400031400/0xa8f741d1c6866198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d478a expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708644.414455:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400031400, rc 0) 00000100:00100000:0.0:1789708644.414533:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:8122:x1876645415756672:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 171us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708644.414541:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 200 00000100:00100000:2.0:1789708644.416414:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708644.416627:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415756800 00000100:00100000:1.0:1789708644.416637:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415756800 00000100:00100000:1.0:1789708644.416743:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 201 00000100:00100000:1.0:1789708644.416754:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:8122:x1876645415756800:12345-192.168.202.53@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789708644.416780:0:5814:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789708644.416811:0:5814:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789708644.416815:0:5814:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789708644.416818:0:5814:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789708644.416820:0:5814:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789708644.418738:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:8122:x1876645415756800:12345-192.168.202.53@tcp:256:mount.lustre.0 Request processed in 1977us (2324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708644.418754:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 201 00000100:00100000:2.0:1789708644.425404:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708644.425529:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415756928 00000100:00100000:0.0:1789708644.425538:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415756928 00000100:00100000:0.0:1789708644.425600:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 202 00000100:00100000:0.0:1789708644.425610:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:8122:x1876645415756928:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789708644.425639:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708644.425684:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400030c00/0xa8f741d1c686619f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4791 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708644.425713:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400030c00/0xa8f741d1c686619f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4791 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708644.425726:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400030c00/0xa8f741d1c686619f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4791 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708644.425735:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400030c00, rc 0) 00000100:00100000:0.0:1789708644.425801:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:8122:x1876645415756928:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 192us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708644.425808:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 202 00000100:00100000:2.0:1789708644.429076:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708644.429162:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415757056 00000100:00100000:1.0:1789708644.429171:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415757056 00000100:00100000:1.0:1789708644.429216:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 203 00000100:00100000:1.0:1789708644.429224:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:8122:x1876645415757056:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789708644.429455:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:8122:x1876645415757056:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 231us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708644.429460:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 203 00000100:00100000:2.0:1789708644.431171:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708644.431306:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415757184 00000100:00100000:3.0:1789708644.431313:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415757184 00000100:00100000:3.0:1789708644.431351:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 204 00000100:00100000:3.0:1789708644.431357:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:8122:x1876645415757184:12345-192.168.202.53@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789708644.432691:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:8122:x1876645415757184:12345-192.168.202.53@tcp:503:mount.lustre.0 Request processed in 1327us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708644.432701:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 204 00000100:00100000:2.0:1789708644.435789:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708644.435980:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415757312 00000100:00100000:0.0:1789708644.435991:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415757312 00000100:00100000:0.0:1789708644.436049:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 205 00000100:00100000:0.0:1789708644.436058:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:8130:x1876645415757312:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789708644.436413:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:8130:x1876645415757312:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 356us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708644.436419:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 205 00000100:00100000:2.0:1789708644.438924:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708644.439038:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415757440 00000100:00100000:3.0:1789708644.439047:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415757440 00000100:00100000:3.0:1789708644.439150:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 206 00000100:00100000:3.0:1789708644.439160:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:8130:x1876645415757440:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789708644.439404:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:8130:x1876645415757440:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 244us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708644.439412:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 206 00000100:00100000:2.0:1789708644.443719:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708644.443769:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708644.443852:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415757952 00000100:00100000:0.0:1789708644.443862:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415757952 00000100:00100000:0.0:1789708644.443926:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415757568 00000100:00100000:0.0:1789708644.443929:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415757568 00000100:00100000:0.0:1789708644.443954:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:0.0:1789708644.443965:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2364:x1876645415757952:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708644.444048:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2364:x1876645415757952:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 86us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708644.444054:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:0.0:1789708644.444068:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:0.0:1789708644.444071:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1876645415757568:12345-192.168.202.53@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789708644.444087:0:5819:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from c9d2a103-cf70-4470-bdd0-387470668318@192.168.202.53@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:0.0:1789708644.444120:0:5819:0:(genops.c:1384:class_connect()) connect: client c9d2a103-cf70-4470-bdd0-387470668318, cookie 0xa8f741d1c68661a6 00000004:00100000:0.0:1789708644.444150:0:5819:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789708644.444366:0:5819:0:(import.c:65:import_set_state_nolock()) ffff8a143ed03800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708644.444388:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c9d2a103-cf70-4470-bdd0-387470668318+6:2360:x1876645415757568:12345-192.168.202.53@tcp:38:mount.lustre.0 Request processed in 316us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708644.444393:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:2.0:1789708644.446836:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708644.446919:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415757696 00000100:00100000:0.0:1789708644.446928:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415757696 00000100:00100000:0.0:1789708644.447104:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:0.0:1789708644.447116:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c9d2a103-cf70-4470-bdd0-387470668318+6:0:x1876645415757696:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789708644.447157:0:5819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789708644.447274:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c9d2a103-cf70-4470-bdd0-387470668318+6:0:x1876645415757696:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 159us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708644.447282:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00080000:2.0:1789708644.447330:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708644.449455:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708644.450238:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415757824 00000100:00100000:1.0:1789708644.450249:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415757824 00000100:00100000:1.0:1789708644.450305:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:1.0:1789708644.450315:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c9d2a103-cf70-4470-bdd0-387470668318+6:8122:x1876645415757824:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789708644.450344:0:5821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789708644.450405:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c9d2a103-cf70-4470-bdd0-387470668318+6:8122:x1876645415757824:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 92us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708644.450412:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:2.0:1789708644.454972:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708644.455099:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415758080 00000100:00100000:1.0:1789708644.455119:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415758080 00000100:00100000:1.0:1789708644.455181:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:1.0:1789708644.455192:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c9d2a103-cf70-4470-bdd0-387470668318+6:8122:x1876645415758080:12345-192.168.202.53@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789708644.455293:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c9d2a103-cf70-4470-bdd0-387470668318+6:8122:x1876645415758080:12345-192.168.202.53@tcp:40:mount.lustre.0 Request processed in 102us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708644.455301:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:1.0:1789708644.458344:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708644.461855:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708644.462297:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708644.462344:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415758464 00000100:00100000:3.0:1789708644.462353:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415758464 00000100:00100000:3.0:1789708644.462399:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:3.0:1789708644.462406:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c9d2a103-cf70-4470-bdd0-387470668318+6:8122:x1876645415758464:12345-192.168.202.53@tcp:33:mount.lustre.0 00000100:00100000:0.0:1789708644.462452:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415758208 00000100:00100000:0.0:1789708644.462458:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415758208 00000004:00200000:3.0:1789708644.462507:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789708644.462532:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415758336 00000100:00100000:0.0:1789708644.462537:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415758336 00000100:00100000:1.0:1789708644.462578:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:1.0:1789708644.462585:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1876645415758208:12345-192.168.202.53@tcp:8:mount.lustre.0 00000100:00100000:3.0:1789708644.462593:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c9d2a103-cf70-4470-bdd0-387470668318+6:8122:x1876645415758464:12345-192.168.202.53@tcp:33:mount.lustre.0 Request processed in 184us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708644.462599:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 1 00010000:00080000:1.0:1789708644.462615:0:6670:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c9d2a103-cf70-4470-bdd0-387470668318@192.168.202.53@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:1.0:1789708644.462646:0:6670:0:(genops.c:1384:class_connect()) connect: client c9d2a103-cf70-4470-bdd0-387470668318, cookie 0xa8f741d1c68661ad 00002000:00100000:1.0:1789708644.462678:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c9d2a103-cf70-4470-bdd0-387470668318/ffff8a14345ec000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789708644.462701:0:6670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789708644.462923:0:6670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789708644.462947:0:6670:0:(import.c:65:import_set_state_nolock()) ffff8a14345ef800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708644.462995:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c9d2a103-cf70-4470-bdd0-387470668318+6:2360:x1876645415758208:12345-192.168.202.53@tcp:8:mount.lustre.0 Request processed in 398us (4651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708644.463003:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:1.0:1789708644.463018:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:1.0:1789708644.463023:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1876645415758336:12345-192.168.202.53@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789708644.463038:0:6670:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c9d2a103-cf70-4470-bdd0-387470668318@192.168.202.53@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:1.0:1789708644.463056:0:6670:0:(genops.c:1384:class_connect()) connect: client c9d2a103-cf70-4470-bdd0-387470668318, cookie 0xa8f741d1c68661b4 00002000:00100000:1.0:1789708644.463062:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c9d2a103-cf70-4470-bdd0-387470668318/ffff8a14345eb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789708644.463076:0:6670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789708644.463208:0:6670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789708644.463223:0:6670:0:(import.c:65:import_set_state_nolock()) ffff8a14345ee800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708644.463264:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c9d2a103-cf70-4470-bdd0-387470668318+6:2360:x1876645415758336:12345-192.168.202.53@tcp:8:mount.lustre.0 Request processed in 238us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708644.463272:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00010000:00010000:2.0:1789708644.474947:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708645.499024:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708645.630839:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789708645.634931:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426269696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708645.635007:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708645.637883:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426269696 00000100:00100000:1.0:1789708645.637897:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426269696 00000100:00100000:1.0:1789708645.637958:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789708645.637968:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426269696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789708645.637994:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708645.638073:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426269696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (3066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708645.638081:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1789708645.638103:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789708645.638138:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14037bb800 x1876645426269696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708645.638158:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426269696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708646.138953:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426269952:0@lo:400:kworker.0 00000100:00100000:1.0:1789708646.139021:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708646.139065:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426269824:0@lo:400:kworker.0 00000100:00100000:1.0:1789708646.139072:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708646.139077:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426270080:0@lo:400:kworker.0 00000100:00100000:1.0:1789708646.139097:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708646.139099:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708646.139120:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426270336:0@lo:400:kworker.0 00000100:00100000:1.0:1789708646.139134:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426269952 00000100:00100000:1.0:1789708646.139141:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426269952 00000100:00100000:3.0:1789708646.139142:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708646.139161:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789708646.139166:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426270208:0@lo:400:kworker.0 00000100:00100000:1.0:1789708646.139179:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426270080 00000100:00100000:3.0:1789708646.139185:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708646.139187:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426270080 00000100:00100000:3.0:1789708646.139207:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426270336 00000100:00100000:1.0:1789708646.139209:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426270208 00000100:00100000:3.0:1789708646.139210:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426270336 00000100:00100000:1.0:1789708646.139211:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426270208 00000100:00100000:1.0:1789708646.139229:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789708646.139234:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789708646.139238:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426269952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708646.139245:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426270336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708646.139284:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426270336:12345-0@lo:400:kworker.0 Request processed in 39us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708646.139284:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426269952:12345-0@lo:400:kworker.0 Request processed in 47us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708646.139292:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789708646.139292:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789708646.139307:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789708646.139313:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426270080:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789708646.139325:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1434bcaa00 x1876645426270336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708646.139339:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426270336:0@lo:400:kworker.0 00000100:00100000:0.0:1789708646.139448:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426269824 00000100:00100000:0.0:1789708646.139456:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426269824 00000100:00100000:0.0:1789708646.139486:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789708646.139494:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426269824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708646.139548:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426269824:12345-0@lo:400:kworker.0 Request processed in 55us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708646.139554:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789708646.139585:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789708646.139593:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426270208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708646.139621:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426270208:12345-0@lo:400:kworker.0 Request processed in 29us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708646.139627:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789708646.139631:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789708646.139640:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143ec32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426270464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708646.139668:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426270208:0@lo:400:kworker.0 00000100:00100000:0.0:1789708646.139678:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426269824:0@lo:400:kworker.0 00000100:00100000:3.0:1789708646.139683:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708646.139747:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426270080:12345-0@lo:400:kworker.0 Request processed in 433us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708646.139753:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789708646.139777:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789708646.139781:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708646.139795:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426270464 00000100:00100000:1.0:1789708646.139799:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426270464 00000100:00100000:1.0:1789708646.139832:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789708646.139839:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426270464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789708646.139853:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708646.142592:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426270464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2743us (2898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708646.142607:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789708646.142688:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426270080:0@lo:400:kworker.0 00000100:00100000:1.0:1789708646.142701:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426269952:0@lo:400:kworker.0 00010000:00080000:3.0:1789708646.143091:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143ec32a00 x1876645426270464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708662 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708646.143113:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143ec32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426270464:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789708646.522853:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789708646.679188:0:7627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c9d2a103-cf70-4470-bdd0-387470668318 00000001:00100000:0.0:1789708647.214789:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c9d2a103-cf70-4470-bdd0-387470668318 00010000:00010000:3.0:1789708647.546847:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789708647.685709:0:10291:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:3.0:1789708647.701696:0:5841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c9d2a103-cf70-4470-bdd0-387470668318 00010000:00010000:3.0:1789708648.573699:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708649.595017:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708649.725939:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708649.725977:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708649.726001:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708649.726022:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708649.726042:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708649.726066:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415758592 00000100:00100000:2.0:1789708649.726075:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415758592 00000100:00100000:2.0:1789708649.726118:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 208 00000100:00100000:2.0:1789708649.726126:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2363:x1876645415758592:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708649.726295:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415758720 00000100:00100000:1.0:1789708649.726307:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415758720 00000100:00100000:1.0:1789708649.726344:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415758848 00000100:00100000:1.0:1789708649.726347:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415758848 00000100:00100000:1.0:1789708649.726370:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00100000:1.0:1789708649.726377:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2363:x1876645415758720:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708649.726429:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2363:x1876645415758592:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 302us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708649.726437:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 208 00000100:00100000:2.0:1789708649.726479:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415758976 00000100:00100000:2.0:1789708649.726483:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415758976 00000100:00100000:2.0:1789708649.726508:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415759104 00000100:00100000:2.0:1789708649.726511:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415759104 00000100:00100000:2.0:1789708649.726527:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:2.0:1789708649.726533:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c9d2a103-cf70-4470-bdd0-387470668318+5:2363:x1876645415758976:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708649.726783:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:0.0:1789708649.726794:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c9d2a103-cf70-4470-bdd0-387470668318+5:2363:x1876645415758848:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708649.726927:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2363:x1876645415758720:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 549us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708649.726934:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00080000:1.0:1789708649.726954:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789708649.726958:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789708649.726961:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708649.726975:0:6670:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789708649.726983:0:6670:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789708649.730846:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c9d2a103-cf70-4470-bdd0-387470668318+5:2363:x1876645415758976:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 4301us (4857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708649.730862:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:2.0:1789708649.730898:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:2.0:1789708649.730917:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c9d2a103-cf70-4470-bdd0-387470668318+5:2363:x1876645415759104:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708649.730982:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c9d2a103-cf70-4470-bdd0-387470668318+5:2363:x1876645415759104:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 70us (4939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708649.730988:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:0.0:1789708649.732612:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c9d2a103-cf70-4470-bdd0-387470668318+5:2363:x1876645415758848:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 5813us (6581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708649.732627:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 42 00010000:00010000:0.0:1789708650.618817:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708650.746984:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14037ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426270592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708650.747055:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708650.747084:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426270592 00000100:00100000:1.0:1789708650.747093:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426270592 00000100:00100000:1.0:1789708650.747169:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789708650.747179:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426270592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789708650.747213:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1789708650.747331:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14037ba680 x1876645426270592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708650.747363:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14037ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426270592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708650.747422:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426270592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 243us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708650.747429:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789708650.747452:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708651.258973:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789708651.258994:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143ec33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426270720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708651.259221:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426270976:0@lo:400:kworker.0 00000100:00100000:1.0:1789708651.259253:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708651.259301:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426271488:0@lo:400:kworker.0 00000100:00100000:1.0:1789708651.259324:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708651.259873:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708651.259927:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434bca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426271104:0@lo:400:kworker.0 00000100:00100000:0.0:1789708651.259956:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708651.260168:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426270976 00000100:00100000:1.0:1789708651.260176:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426270976 00000100:00100000:1.0:1789708651.260230:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426271104 00000100:00100000:1.0:1789708651.260234:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426271104 00000100:00100000:1.0:1789708651.260265:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789708651.260273:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426270976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708651.260326:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426270976:12345-0@lo:400:kworker.0 Request processed in 53us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708651.260333:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789708651.260466:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426271232:0@lo:400:kworker.0 00000100:00100000:3.0:1789708651.260496:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708651.260524:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789708651.260536:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426270848:0@lo:400:kworker.0 00000100:00100000:3.0:1789708651.260563:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708651.260584:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876645426271360:0@lo:400:kworker.0 00000100:00100000:3.0:1789708651.260604:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708651.260626:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426270720 00000100:00100000:3.0:1789708651.260630:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426270720 00000100:00100000:3.0:1789708651.260675:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789708651.260683:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426270720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789708651.260710:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708651.260742:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426270720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708651.260748:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789708651.260769:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426271488 00000100:00100000:3.0:1789708651.260773:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426271488 00000100:00100000:3.0:1789708651.261141:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426271232 00000100:00100000:3.0:1789708651.261145:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426271232 00000100:00100000:3.0:1789708651.261167:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789708651.261173:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426271488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708651.261208:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426271488:12345-0@lo:400:kworker.0 Request processed in 35us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708651.261215:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789708651.261226:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789708651.261232:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426271232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708651.261264:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426271232:12345-0@lo:400:kworker.0 Request processed in 32us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708651.261269:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1789708651.261310:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1434bcb480 x1876645426271232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708651.261332:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426271232:0@lo:400:kworker.0 00000100:00100000:1.0:1789708651.261460:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426271360 00000100:00100000:1.0:1789708651.261465:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426271360 00000100:00100000:1.0:1789708651.261484:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789708651.261491:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426271104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708651.261533:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426271104:12345-0@lo:400:kworker.0 Request processed in 43us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708651.261539:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789708651.261549:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789708651.261555:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876645426271360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708651.261581:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876645426271360:12345-0@lo:400:kworker.0 Request processed in 27us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708651.261587:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789708651.261624:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143ec33800 x1876645426270720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708651.261638:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143ec33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426270720:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789708651.261676:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789708651.261681:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708651.261692:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426270848 00000100:00100000:1.0:1789708651.261696:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426270848 00000100:00100000:1.0:1789708651.261721:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789708651.261735:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3288:x1876645426270848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708651.261764:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3288:x1876645426270848:12345-0@lo:400:kworker.0 Request processed in 31us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708651.261769:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789708651.262935:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434bca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426271104:0@lo:400:kworker.0 00000100:00100000:0.0:1789708651.262980:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426270976:0@lo:400:kworker.0 00010000:00080000:0.0:1789708651.262993:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1434bc8380 x1876645426271488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708651.263003:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426271488:0@lo:400:kworker.0 00000100:00100000:3.0:1789708651.263174:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426270848:0@lo:400:kworker.0 00000100:00100000:3.0:1789708651.263187:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876645426271360:0@lo:400:kworker.0 00010000:00010000:3.0:1789708651.645499:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708652.666765:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708653.690788:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708654.722755:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708654.847349:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708654.847383:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708654.847426:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708654.847450:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708654.847489:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708654.847518:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415759616 00000100:00100000:2.0:1789708654.847528:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415759616 00000100:00100000:2.0:1789708654.847581:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415759744 00000100:00100000:2.0:1789708654.847585:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415759744 00000100:00100000:2.0:1789708654.847608:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:2.0:1789708654.847617:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c9d2a103-cf70-4470-bdd0-387470668318+5:2362:x1876645415759616:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708654.847711:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c9d2a103-cf70-4470-bdd0-387470668318+5:2362:x1876645415759616:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 94us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708654.847719:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:2.0:1789708654.847735:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:2.0:1789708654.847741:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143facb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c9d2a103-cf70-4470-bdd0-387470668318+5:2361:x1876645415759744:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708654.847766:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143facb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c9d2a103-cf70-4470-bdd0-387470668318+5:2361:x1876645415759744:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 26us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708654.847773:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:2.0:1789708654.847789:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415759360 00000100:00100000:2.0:1789708654.847793:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415759360 00000100:00100000:2.0:1789708654.847819:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415759488 00000100:00100000:2.0:1789708654.847827:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415759488 00000100:00100000:2.0:1789708654.847851:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:2.0:1789708654.847858:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2362:x1876645415759360:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708654.847885:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2362:x1876645415759360:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 27us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708654.847892:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:2.0:1789708654.847903:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:2.0:1789708654.847909:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c9d2a103-cf70-4470-bdd0-387470668318+5:2361:x1876645415759488:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708654.847931:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c9d2a103-cf70-4470-bdd0-387470668318+5:2361:x1876645415759488:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 22us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708654.847937:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00080000:2.0:1789708654.847954:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789708654.847959:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789708654.847961:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708654.848137:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415759232 00000100:00100000:3.0:1789708654.848142:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415759232 00000100:00100000:3.0:1789708654.848180:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 210 00000100:00100000:3.0:1789708654.848187:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2361:x1876645415759232:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708654.848371:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2361:x1876645415759232:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 32us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708654.848380:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 210 00010000:00010000:3.0:1789708655.738812:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708655.866932:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708655.866955:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1410808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426271616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708655.867027:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708655.867334:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426271616 00000100:00100000:3.0:1789708655.867343:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426271616 00000100:00100000:3.0:1789708655.867416:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789708655.867426:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426271616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789708655.867459:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708655.867512:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426271616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708655.867519:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1789708655.867562:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1410808000 x1876645426271616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708655.867582:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1410808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426271616:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789708655.867684:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708656.378998:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426271872:0@lo:400:kworker.0 00000100:00100000:2.0:1789708656.379007:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143facb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426272128:0@lo:400:kworker.0 00000100:00100000:3.0:1789708656.379022:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426271744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708656.379087:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143faca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426272000:0@lo:400:kworker.0 00000100:00100000:0.0:1789708656.381907:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708656.381945:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708656.381958:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708656.381998:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708656.382044:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426271872 00000100:00100000:1.0:1789708656.382052:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426271872 00000100:00100000:3.0:1789708656.382093:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426272256:0@lo:400:kworker.0 00000100:00100000:1.0:1789708656.382110:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789708656.382121:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426271872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708656.382137:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708656.382181:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426271872:12345-0@lo:400:kworker.0 Request processed in 61us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708656.382183:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426271744 00000100:00100000:3.0:1789708656.382189:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426271744 00000100:00100000:1.0:1789708656.382194:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789708656.382232:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789708656.382240:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410808000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426271744:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708656.382260:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426272256 00000100:00100000:1.0:1789708656.382265:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426272256 00002000:00000024:3.0:1789708656.382272:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708656.382298:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789708656.382307:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426272256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708656.382317:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410808000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426271744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708656.382325:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789708656.382351:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426272256:12345-0@lo:400:kworker.0 Request processed in 44us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708656.382358:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1789708656.382369:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1434bc9f80 x1876645426271744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708672 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708656.382383:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426272128 00000100:00100000:1.0:1789708656.382389:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426272128 00000100:00100000:3.0:1789708656.382392:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434bc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426271744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708656.382433:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426272000 00000100:00100000:1.0:1789708656.382437:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426272000 00000100:00100000:1.0:1789708656.382476:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789708656.382482:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426272128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708656.382518:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426272128:12345-0@lo:400:kworker.0 Request processed in 36us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708656.382536:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789708656.382548:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789708656.382554:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426272000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708656.382583:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426272000:12345-0@lo:400:kworker.0 Request processed in 30us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708656.382589:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1789708656.382624:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789708656.382628:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708656.382681:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143faca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426272000:0@lo:400:kworker.0 00000100:00100000:1.0:1789708656.382689:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143facad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426272512:0@lo:400:kworker.0 00000100:00100000:1.0:1789708656.382711:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789708656.382822:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143fac9f80 x1876645426272256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708656.382833:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426272256:0@lo:400:kworker.0 00000100:00100000:3.0:1789708656.382923:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426272512 00000100:00100000:3.0:1789708656.382927:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426272512 00000100:00100000:3.0:1789708656.383005:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789708656.383022:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426272512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708656.383059:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426272512:12345-0@lo:400:kworker.0 Request processed in 39us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708656.383075:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1789708656.383260:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143facad80 x1876645426272512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708656.383276:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143facad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426272512:0@lo:400:kworker.0 00000100:00100000:0.0:1789708656.383631:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426271872:0@lo:400:kworker.0 00000100:00100000:0.0:1789708656.383641:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426272384:0@lo:400:kworker.0 00000100:00100000:0.0:1789708656.383693:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708656.383740:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426272384 00000100:00100000:1.0:1789708656.383745:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426272384 00000100:00100000:1.0:1789708656.383790:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789708656.383797:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426272384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708656.383834:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426272384:12345-0@lo:400:kworker.0 Request processed in 37us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708656.383840:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1789708656.383907:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708656.383978:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143facb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426272128:0@lo:400:kworker.0 00000100:00100000:0.0:1789708656.386628:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426272384:0@lo:400:kworker.0 00010000:00010000:3.0:1789708656.762840:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789708657.777495:0:10994:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789708657.787173:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708658.811561:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789708659.819169:0:11141:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff83ed6cf0 20000000:00000080:2.0:1789708659.819185:0:11141:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a143efc8000 uarg=0000000000000000 20000000:01000000:2.0:1789708659.819220:0:11141:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789708659.819225:0:11141:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789708659.819230:0:11141:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789708659.820044:0:11142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789708659.820260:0:11141:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789708659.827561:0:11141:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789708659.827592:0:11141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c68661bb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.827625:0:11141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6866160 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.827633:0:11141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a143fa38800/0xa8f741d1c6866175 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686616e expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.827640:0:11141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a143fa39c00/0xa8f741d1c6866183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686617c expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.827676:0:11141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a143fa38000/0xa8f741d1c686618a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4759 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.827686:0:11141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1400030c00/0xa8f741d1c686619f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4791 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.827695:0:11141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c68661bb lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.827744:0:11141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1400030c00/0xa8f741d1c686619f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4791 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.827758:0:11141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1400030c00/0xa8f741d1c686619f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4791 expref: 12 pid: 5813 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708659.827777:0:11141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143facb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11141:1876645426272640:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708659.827900:0:11141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a143fa38000/0xa8f741d1c686618a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4759 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.827909:0:11141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a143fa38000/0xa8f741d1c686618a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4759 expref: 12 pid: 5812 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708659.827924:0:11141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fac9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11141:1876645426272768:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708659.827958:0:11141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a143fa39c00/0xa8f741d1c6866183 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c686617c expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.827966:0:11141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a143fa39c00/0xa8f741d1c6866183 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c686617c expref: 18 pid: 5812 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708659.827975:0:11141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fac9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11141:1876645426272896:0@lo:104: 00000100:00100000:2.0:1789708659.828022:0:11141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708659.828058:0:11141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a143fa38800/0xa8f741d1c6866175 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c686616e expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.828067:0:11141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a143fa38800/0xa8f741d1c6866175 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c686616e expref: 18 pid: 5814 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708659.828076:0:11141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fac9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11141:1876645426273024:0@lo:104: 00000100:00100000:2.0:1789708659.828096:0:11141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708659.828122:0:11141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6866160 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708659.828127:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426272896 00010000:00010000:2.0:1789708659.828131:0:11141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866167 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6866160 expref: 18 pid: 5813 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708659.828136:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426272896 00000100:00100000:2.0:1789708659.828144:0:11141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143faca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11141:1876645426273152:0@lo:104: 00000100:00100000:2.0:1789708659.828177:0:11141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708659.828179:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426273024 00000100:00100000:1.0:1789708659.828184:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426273024 00000100:00100000:2.0:1789708659.828188:0:11141:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140766a180 going to sleep for 11 seconds 00000100:00100000:1.0:1789708659.828202:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426273152 00000100:00100000:1.0:1789708659.828205:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426273152 00000100:00100000:1.0:1789708659.828219:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789708659.828227:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143facb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+5:11141:x1876645426272896:12345-0@lo:104: 00010000:00010000:1.0:1789708659.828239:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a143fa38200/0xa8f741d1c686617c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6866183 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.828299:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789708659.828305:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143facb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+5:11141:x1876645426272896:12345-0@lo:104: Request processed in 79us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708659.828312:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789708659.828329:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789708659.828335:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+4:11141:x1876645426273024:12345-0@lo:104: 00010000:00010000:1.0:1789708659.828342:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c686616e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6866175 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.828510:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789708659.828516:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+4:11141:x1876645426273024:12345-0@lo:104: Request processed in 181us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708659.828522:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789708659.828535:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789708659.828541:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:11141:x1876645426273152:12345-0@lo:104: 00010000:00010000:1.0:1789708659.828548:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c6866160 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6866167 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.828593:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789708659.828598:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:11141:x1876645426273152:12345-0@lo:104: Request processed in 58us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708659.828605:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789708659.828623:0:8433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789708659.828629:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a143fa38200/0xa8f741d1c686617c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6866183 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.828636:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38200 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:1.0:1789708659.828640:0:8433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa38200/0xa8f741d1c686617c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6866183 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.828671:0:8433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a143fa38200/0xa8f741d1c686617c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6866183 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708659.828679:0:8433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa38200/0xa8f741d1c686617c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6866183 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708659.828686:0:8433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789708659.828713:0:8433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a143fa38200/0xa8f741d1c686617c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866183 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.828719:0:8433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789708659.828738:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38200/0xa8f741d1c686617c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866183 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.828744:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a143fa38200/0xa8f741d1c686617c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866183 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.828766:0:8433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789708659.828771:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c686616e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6866175 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.828777:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400030800 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:1.0:1789708659.828779:0:8433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c686616e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6866175 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.828787:0:8433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c686616e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6866175 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708659.828793:0:8433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c686616e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6866175 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708659.828798:0:8433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789708659.828809:0:11141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fac9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11141:1876645426272896:0@lo:104: 00010000:00010000:1.0:1789708659.828815:0:8433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c686616e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866175 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708659.828822:0:11141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fac9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11141:1876645426273024:0@lo:104: 00010000:00010000:1.0:1789708659.828824:0:8433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789708659.828842:0:11141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143faca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11141:1876645426273152:0@lo:104: 00010000:00010000:1.0:1789708659.828843:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c686616e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866175 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.828852:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1400030800/0xa8f741d1c686616e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866175 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.828864:0:8433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708659.828868:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c6866160 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6866167 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.828885:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400031e00 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:1.0:1789708659.828888:0:8433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c6866160 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6866167 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.828894:0:8433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c6866160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6866167 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708659.828900:0:8433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c6866160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6866167 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708659.828905:0:8433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789708659.828920:0:8433:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c6866160 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866167 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.828926:0:8433:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789708659.828932:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c6866160 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866167 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.828939:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1400031e00/0xa8f741d1c6866160 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6866167 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.828952:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.828953:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.828955:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708659.828963:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708659.828981:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426273280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708659.829014:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708659.829068:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426273280 00000100:00100000:1.0:1789708659.829069:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426273408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708659.829076:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426273280 00010000:00010000:2.0:1789708659.829100:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a143fa39c00/0xa8f741d1c6866183 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c686617c expref: 19 pid: 5812 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708659.829111:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708659.829143:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789708659.829148:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434bca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426273536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708659.829184:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708659.829258:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426273408 00000100:00100000:2.0:1789708659.829263:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426273408 00010000:00010000:2.0:1789708659.829280:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a143fa38800/0xa8f741d1c6866175 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c686616e expref: 20 pid: 5814 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708659.829301:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789708659.829309:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1408280c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34efb293-a6d4-48d2-a113-9ec9a49feb73+20:3287:x1876645426273280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708659.829320:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708659.829325:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a143fa39c00/0xa8f741d1c6866183 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c686617c expref: 20 pid: 5812 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.829334:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a143fa39c00/0xa8f741d1c6866183 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c686617c expref: 20 pid: 5812 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.829349:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa39c00/0xa8f741d1c6866183 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c686617c expref: 20 pid: 5812 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.829362:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708659.829376:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426273536 00000100:00100000:1.0:1789708659.829382:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426273536 00010000:00010000:1.0:1789708659.829397:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866167 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6866160 expref: 20 pid: 5813 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708659.829710:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789708659.829719:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+20:3288:x1876645426273408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708659.829727:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708659.829732:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a143fa38800/0xa8f741d1c6866175 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c686616e expref: 20 pid: 5814 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.829740:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a143fa38800/0xa8f741d1c6866175 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c686616e expref: 20 pid: 5814 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.829751:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa38800/0xa8f741d1c6866175 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c686616e expref: 20 pid: 5814 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.829760:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708659.829824:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1408280c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3287:x1876645426273280:12345-0@lo:103:ldlm_bl.0 Request processed in 516us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708659.829842:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789708659.829945:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708659.830425:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789708659.830436:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3288:x1876645426273536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708659.830446:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708659.830452:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866167 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6866160 expref: 19 pid: 5813 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.830461:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6866160 expref: 19 pid: 5813 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.830471:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a14013a0200/0xa8f741d1c6866167 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6866160 expref: 19 pid: 5813 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708659.830481:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708659.830490:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:3288:x1876645426273408:12345-0@lo:103:ldlm_bl.0 Request processed in 771us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708659.830498:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789708659.830514:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:3288:x1876645426273536:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708659.830522:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789708659.830560:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426273280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708659.830625:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434bcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426273408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708659.830641:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434bca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426273536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708659.831314:0:11141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143facb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11141:1876645426272640:192.168.202.53@tcp:104: 00000100:00100000:2.0:1789708659.831325:0:11141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fac9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11141:1876645426272768:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708659.831363:0:11141:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c68661bb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708659.833683:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708659.833762:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708659.833821:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415759872 00000100:00100000:2.0:1789708659.833829:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415759872 00010000:00010000:2.0:1789708659.833862:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1400030c00/0xa8f741d1c686619f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4791 expref: 13 pid: 5813 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708659.833895:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415760000 00000100:00100000:2.0:1789708659.833897:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415760000 00010000:00010000:2.0:1789708659.833909:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a143fa38000/0xa8f741d1c686618a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4759 expref: 14 pid: 5812 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708659.833940:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:2.0:1789708659.833949:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7afaea2d-d635-45b7-851c-2e40ec565b3d+14:2361:x1876645415759872:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708659.833963:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708659.833969:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1400030c00/0xa8f741d1c686619f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4791 expref: 14 pid: 5813 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.833980:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1400030c00/0xa8f741d1c686619f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4791 expref: 14 pid: 5813 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.833997:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400030c00/0xa8f741d1c686619f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4791 expref: 14 pid: 5813 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.834013:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708659.834027:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:3.0:1789708659.834039:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2362:x1876645415760000:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708659.834050:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708659.834055:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a143fa38000/0xa8f741d1c686618a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4759 expref: 13 pid: 5812 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708659.834062:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2361:x1876645415759872:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 111us (416us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708659.834071:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a143fa38000/0xa8f741d1c686618a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4759 expref: 13 pid: 5812 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708659.834072:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 28 00010000:00010000:3.0:1789708659.834100:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa38000/0xa8f741d1c686618a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4759 expref: 12 pid: 5812 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.834113:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c68661bb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.834127:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c68661bb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.834142:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c68661bb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.834150:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c68661bb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.834157:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c68661bb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.834164:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c68661bb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.834171:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6ac00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708659.834175:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c68661bb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.834184:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c68661bb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.834204:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c68661bb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708659.834227:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708659.834267:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7afaea2d-d635-45b7-851c-2e40ec565b3d+11:2362:x1876645415760000:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 230us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708659.834274:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 29 00010000:00010000:2.0:1789708659.834347:0:11141:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c68661bb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.834355:0:11141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c68661bb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708659.834363:0:11141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c68661bb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708659.835389:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708659.961946:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708659.962000:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708659.962028:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708659.962087:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708659.962133:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415760512 00000100:00100000:1.0:1789708659.962143:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415760512 00000100:00100000:1.0:1789708659.962207:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415760384 00000100:00100000:1.0:1789708659.962211:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415760384 00000100:00100000:1.0:1789708659.962233:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:1.0:1789708659.962242:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c9d2a103-cf70-4470-bdd0-387470668318+5:2361:x1876645415760512:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708659.962325:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c9d2a103-cf70-4470-bdd0-387470668318+5:2361:x1876645415760512:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 84us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708659.962334:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:1.0:1789708659.962350:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 26 00000100:00100000:1.0:1789708659.962358:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c9d2a103-cf70-4470-bdd0-387470668318+5:2362:x1876645415760384:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708659.962398:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c9d2a103-cf70-4470-bdd0-387470668318+5:2362:x1876645415760384:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 40us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708659.962404:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 26 00000100:00100000:2.0:1789708659.962636:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415760256 00000100:00100000:2.0:1789708659.962642:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415760256 00000100:00100000:2.0:1789708659.962724:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415760128 00000100:00100000:2.0:1789708659.962728:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415760128 00000100:00100000:2.0:1789708659.962753:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:2.0:1789708659.962760:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c9d2a103-cf70-4470-bdd0-387470668318+5:2361:x1876645415760256:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708659.962796:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c9d2a103-cf70-4470-bdd0-387470668318+5:2361:x1876645415760256:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 36us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708659.962802:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:2.0:1789708659.962817:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:2.0:1789708659.962824:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2362:x1876645415760128:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708659.962846:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2362:x1876645415760128:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708659.962851:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00080000:3.0:1789708659.962968:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789708659.962973:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789708659.962975:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789708660.858799:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789708660.858931:0:5816:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789708660.858935:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1302f7e800 from 7 10000000:01000000:3.0:1789708660.858941:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708660.858989:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c68661c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708660.859002:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c68661c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708660.859014:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c68661c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708660.859041:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426273664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708660.859110:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708660.859155:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708660.859243:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426273664 00000100:00100000:0.0:1789708660.859258:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426273664 00000100:00100000:0.0:1789708660.859370:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789708660.859381:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:5816:x1876645426273664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708660.859395:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708660.859409:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400031000/0xa8f741d1c68661c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c68661c2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708660.859430:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400031000/0xa8f741d1c68661c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c68661c2 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708660.859441:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400031000/0xa8f741d1c68661c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c68661c2 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708660.859450:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400031000, rc 0) 00000100:00100000:0.0:1789708660.859488:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426273664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708660.859495:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789708660.859640:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426273664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708660.859673:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c68661c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68661c9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708660.859683:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c68661c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c68661c9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708660.859744:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426273792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708660.859770:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708660.861514:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708660.862666:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426273792 00000100:00100000:1.0:1789708660.862678:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426273792 00000100:00100000:1.0:1789708660.862732:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789708660.862743:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426273792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708660.863643:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426273792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 898us (3868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708660.863675:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789708660.863987:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426273792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708660.864047:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426273920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708660.864098:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708660.864178:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708660.864222:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426273920 00000100:00100000:1.0:1789708660.864228:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426273920 00000100:00100000:1.0:1789708660.864308:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789708660.864317:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426273920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708660.864501:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426273920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708660.864509:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789708660.864579:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426273920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789708660.865152:0:11197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789708660.865210:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789708660.865231:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708660.865241:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c68661c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68661c9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708660.865252:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c68661c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68661c9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708660.865261:0:5816:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789708660.865264:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a143fa6b000 from 7 10000000:01000000:3.0:1789708660.865266:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708660.865293:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c68661d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708660.865300:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c68661d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708660.865332:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c68661d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708660.865347:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426274048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708660.865392:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708660.865583:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708660.865615:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426274048 00000100:00100000:0.0:1789708660.865621:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426274048 00000100:00100000:0.0:1789708660.865664:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789708660.865672:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426274048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708660.865683:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708660.865695:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400030000/0xa8f741d1c68661d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c68661d0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708660.865716:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400030000/0xa8f741d1c68661d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c68661d0 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708660.865727:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400030000/0xa8f741d1c68661d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c68661d0 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708660.865741:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400030000, rc 0) 00000100:00100000:0.0:1789708660.865778:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426274048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708660.865785:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789708660.865986:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426274048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708660.865999:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c68661d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68661d7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708660.866008:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c68661d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c68661d7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708660.866049:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426274176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708660.866075:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708660.866146:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708660.866231:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426274176 00000100:00100000:0.0:1789708660.866235:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426274176 00000100:00100000:0.0:1789708660.866293:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789708660.866300:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426274176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708660.866533:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426274176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708660.866541:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789708660.866599:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426274176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708660.866635:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426274304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708660.866711:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708660.866810:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708660.866844:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426274304 00000100:00100000:1.0:1789708660.866850:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426274304 00000100:00100000:1.0:1789708660.866874:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789708660.866935:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426274304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708660.867091:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426274304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708660.867097:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789708660.867204:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426274304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789708660.868063:0:11198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789708660.868223:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789708660.868246:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708660.868257:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c68661d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68661d7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708660.868276:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c68661d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68661d7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708660.868286:0:5816:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789708660.868289:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1410604800 from 7 10000000:01000000:3.0:1789708660.868292:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708660.868317:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c68661de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708660.868325:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c68661de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708660.868334:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c68661de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708660.868351:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426274432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708660.869024:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708660.869060:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708660.869130:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426274432 00000100:00100000:1.0:1789708660.869137:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426274432 00000100:00100000:1.0:1789708660.869183:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789708660.869192:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426274432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708660.869206:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708660.869220:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143efc5800/0xa8f741d1c68661e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c68661de expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708660.869244:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143efc5800/0xa8f741d1c68661e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c68661de expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708660.869255:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143efc5800/0xa8f741d1c68661e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c68661de expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708660.869275:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5800, rc 0) 00000100:00100000:1.0:1789708660.869320:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426274432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708660.869327:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789708660.869398:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426274432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708660.869412:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c68661de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68661e5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708660.869421:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c68661de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c68661e5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708660.869469:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426274560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708660.869493:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708660.869524:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708660.869684:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426274560 00000100:00100000:0.0:1789708660.869689:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426274560 00000100:00100000:0.0:1789708660.869718:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789708660.869725:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426274560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708660.870122:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426274560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 396us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708660.870130:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789708660.870403:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426274560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708660.870446:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426274688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708660.870487:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708660.870518:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708660.870561:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426274688 00000100:00100000:1.0:1789708660.870566:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426274688 00000100:00100000:1.0:1789708660.870600:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789708660.870607:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426274688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708660.870788:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426274688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708660.870796:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789708660.871060:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426274688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789708660.873269:0:11199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789708660.873522:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789708660.873551:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789708660.873561:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c68661de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68661e5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708660.873575:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c68661de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68661e5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708660.986919:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a141080b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426274816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708660.987005:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708660.987059:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426274816 00000100:00100000:3.0:1789708660.987070:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426274816 00000100:00100000:3.0:1789708660.987133:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789708660.987143:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426274816:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789708660.987176:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789708660.987178:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789708660.987250:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426274816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708660.987259:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1789708660.987279:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a141080b800 x1876645426274816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708660.987302:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a141080b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426274816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708661.498894:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708661.498915:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fa04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426274944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708661.498980:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708661.499047:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426274944 00000100:00100000:1.0:1789708661.499055:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426274944 00000100:00100000:1.0:1789708661.499110:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789708661.499120:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426274944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789708661.499157:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708661.499198:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426274944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708661.499205:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789708661.499238:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789708661.499270:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143fa04700 x1876645426274944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708677 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708661.499287:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fa04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426274944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708661.500146:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876645426275200:0@lo:400:kworker.0 00000100:00100000:1.0:1789708661.500181:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708661.500205:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789708661.500210:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fa04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426275072:0@lo:400:kworker.0 00000100:00100000:1.0:1789708661.500235:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708661.500257:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fa07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426275584:0@lo:400:kworker.0 00000100:00100000:1.0:1789708661.500275:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708661.500299:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426275200 00000100:00100000:1.0:1789708661.500304:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426275200 00000100:00100000:1.0:1789708661.500331:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426275584 00000100:00100000:1.0:1789708661.500334:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426275584 00000100:00100000:1.0:1789708661.500371:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789708661.500380:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876645426275200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708661.500421:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876645426275200:12345-0@lo:400:kworker.0 Request processed in 42us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708661.500427:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789708661.500439:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789708661.500444:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426275584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708661.500466:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426275584:12345-0@lo:400:kworker.0 Request processed in 23us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708661.500471:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789708661.500486:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426275072 00000100:00100000:1.0:1789708661.500497:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426275072 00000100:00100000:1.0:1789708661.500519:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789708661.500524:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426275072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708661.500548:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426275072:12345-0@lo:400:kworker.0 Request processed in 25us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708661.500553:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:1.0:1789708661.500583:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708661.500592:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fa06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426275456:0@lo:400:kworker.0 00000100:00100000:1.0:1789708661.500617:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708661.500634:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789708661.500639:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fa05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426275328:0@lo:400:kworker.0 00000100:00100000:1.0:1789708661.500906:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708661.501045:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426275456 00000100:00100000:1.0:1789708661.501049:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426275456 00000100:00100000:1.0:1789708661.501084:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789708661.501091:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426275456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708661.501126:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426275456:12345-0@lo:400:kworker.0 Request processed in 36us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708661.501132:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789708661.501162:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143fa06300 x1876645426275456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708661.501175:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fa06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426275456:0@lo:400:kworker.0 00000100:00100000:1.0:1789708661.501194:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fa04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426275072:0@lo:400:kworker.0 00000100:00100000:1.0:1789708661.501203:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fa07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426275584:0@lo:400:kworker.0 00000100:00100000:1.0:1789708661.501210:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876645426275200:0@lo:400:kworker.0 00000100:00100000:3.0:1789708661.501893:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426275328 00000100:00100000:3.0:1789708661.501900:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426275328 00000100:00100000:3.0:1789708661.501988:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789708661.501994:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426275328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708661.502032:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426275328:12345-0@lo:400:kworker.0 Request processed in 39us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708661.502036:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789708661.502058:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fa05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426275328:0@lo:400:kworker.0 00000100:00080000:1.0:1789708661.503474:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708661.884500:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708661.884564:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415760640 00010000:00010000:1.0:1789708661.884577:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708661.884577:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415760640 00000100:00100000:0.0:1789708661.884736:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 222 00000100:00100000:0.0:1789708661.884749:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+11:5595:x1876645415760640:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708661.884766:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708661.884781:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400030800/0xa8f741d1c68661ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d47bb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708661.884812:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400030800/0xa8f741d1c68661ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47bb expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708661.884824:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400030800/0xa8f741d1c68661ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47bb expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708661.884833:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400030800, rc 0) 00000100:00100000:0.0:1789708661.884894:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:5595:x1876645415760640:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 148us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708661.884901:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 222 00000100:00100000:1.0:1789708661.905089:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708661.908515:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415760768 00000100:00100000:0.0:1789708661.908530:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415760768 00000100:00100000:0.0:1789708661.908599:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 223 00000100:00100000:0.0:1789708661.908610:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:5595:x1876645415760768:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708661.908938:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:5595:x1876645415760768:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 328us (3858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708661.908946:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 223 00000100:00100000:1.0:1789708661.910907:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708661.910981:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415760896 00000100:00100000:0.0:1789708661.910992:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415760896 00000100:00100000:0.0:1789708661.911045:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 224 00000100:00100000:0.0:1789708661.911056:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:5595:x1876645415760896:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708661.911277:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:5595:x1876645415760896:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 Request processed in 222us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708661.911285:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 224 00000100:00100000:1.0:1789708661.922235:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708661.922408:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415761024 00000100:00100000:0.0:1789708661.922420:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415761024 00000100:00100000:0.0:1789708661.922545:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 225 00000100:00100000:0.0:1789708661.922557:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:5595:x1876645415761024:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708661.922575:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708661.922591:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400031e00/0xa8f741d1c68661f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d47c2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708661.922621:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400031e00/0xa8f741d1c68661f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47c2 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708661.922633:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400031e00/0xa8f741d1c68661f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47c2 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708661.922643:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400031e00, rc 0) 00000100:00100000:0.0:1789708661.922722:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:5595:x1876645415761024:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 167us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708661.922729:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 225 00000100:00100000:1.0:1789708661.926510:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708661.926617:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415761152 00000100:00100000:3.0:1789708661.926627:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415761152 00000100:00100000:3.0:1789708661.926709:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 226 00000100:00100000:3.0:1789708661.926719:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:5595:x1876645415761152:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708661.927008:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:5595:x1876645415761152:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 288us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708661.927019:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 226 00000100:00100000:0.0:1789708661.929614:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708661.929903:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415761280 00000100:00100000:2.0:1789708661.929915:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415761280 00000100:00100000:2.0:1789708661.929958:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 227 00000100:00100000:2.0:1789708661.929965:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:5595:x1876645415761280:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708661.930166:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:5595:x1876645415761280:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 Request processed in 200us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708661.930173:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 227 00000001:02000400:0.0:1789708662.134791:0:11338:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789708662.907804:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708663.931371:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789708664.031481:0:11437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:17:43 (1789708663) === 00000100:00100000:1.0:1789708664.159631:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708664.160933:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415761408 00000100:00100000:2.0:1789708664.160946:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415761408 00000100:00100000:2.0:1789708664.161101:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:2.0:1789708664.161113:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:14bb7f14-3461-47f6-86c9-db3f545050ad+6:9673:x1876645415761408:12345-192.168.202.53@tcp:700:mkdir.0 00000100:00100000:2.0:1789708664.161206:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:14bb7f14-3461-47f6-86c9-db3f545050ad+6:9673:x1876645415761408:12345-192.168.202.53@tcp:700:mkdir.0 Request processed in 96us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708664.161214:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00080000:1.0:1789708664.161407:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708664.163086:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708664.163157:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415761664 00000100:00100000:1.0:1789708664.163165:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415761664 00000100:00100000:1.0:1789708664.163221:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:1.0:1789708664.163230:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+6:9673:x1876645415761664:12345-192.168.202.53@tcp:36:mkdir.0 00010000:00010000:1.0:1789708664.163284:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708664.163310:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68660db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4744 expref: 6 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.163337:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:1.0:1789708664.163348:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708664.163698:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c68661fa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.163713:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c68661fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.163722:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c68661fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.163774:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4000/0xa8f741d1c6866201 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.163788:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4000/0xa8f741d1c6866201 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.163795:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4000/0xa8f741d1c6866201 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708664.164994:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789708664.165007:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c68661fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.165016:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c68661fa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.165022:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c68661fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.165028:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708664.165033:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c68661fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.165041:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c68661fa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.165773:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14033c4400) 00010000:00010000:1.0:1789708664.165779:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708664.165785:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c68661fa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.165793:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c68661fa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708664.165825:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064e7020e reply state 000000007146de18 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4000/0xa8f741d1c6866201 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708664.165834:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789708664.165979:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+7:9673:x1876645415761664:12345-192.168.202.53@tcp:36:mkdir.0 Request processed in 2746us (2895us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789708664.165988:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00010000:00010000:2.0:1789708664.168195:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4000/0xa8f741d1c6866201 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.168214:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4000/0xa8f741d1c6866201 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.168222:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4000/0xa8f741d1c6866201 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.168227:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708664.168232:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4000/0xa8f741d1c6866201 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.168238:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4000/0xa8f741d1c6866201 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.168272:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a14033c4300) 00010000:00010000:2.0:1789708664.168275:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708664.168280:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4000/0xa8f741d1c6866201 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.168286:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4000/0xa8f741d1c6866201 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708664.174897:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708664.174959:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415761792 00000100:00100000:3.0:1789708664.174972:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415761792 00000100:00100000:3.0:1789708664.175261:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:3.0:1789708664.175274:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+6:9674:x1876645415761792:12345-192.168.202.53@tcp:101:chmod.0 00010000:00010000:3.0:1789708664.175297:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708664.175321:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38400/0xa8f741d1c6866208 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d47c9 expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.175399:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38e00/0xa8f741d1c686620f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.175412:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38e00/0xa8f741d1c686620f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.175424:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38e00/0xa8f741d1c686620f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708664.175732:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789708664.175737:0:7140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789708664.175879:0:7140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38e00/0xa8f741d1c686620f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.175904:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38400/0xa8f741d1c6866208 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47c9 expref: 8 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.175925:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38e00/0xa8f741d1c686620f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47c9 expref: 7 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.175934:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1411b4ad00) 00010000:00010000:0.0:1789708664.175937:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708664.175940:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38e00, rc 0) 00000100:00100000:0.0:1789708664.175996:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+7:9674:x1876645415761792:12345-192.168.202.53@tcp:101:chmod.0 Request processed in 726us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708664.176002:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:0.0:1789708664.181007:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708664.181061:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415762048 00000100:00100000:2.0:1789708664.181073:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415762048 00000100:00100000:2.0:1789708664.181140:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:2.0:1789708664.181151:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+7:9674:x1876645415762048:12345-192.168.202.53@tcp:36:chmod.0 00010000:00010000:2.0:1789708664.181215:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708664.181250:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38e00/0xa8f741d1c686620f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47c9 expref: 7 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.181271:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1411b4ad00) 00010000:00010000:2.0:1789708664.181283:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708664.181333:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6866216 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.181349:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6866216 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.181359:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6866216 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708664.182673:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035a345ce reply state 000000005ca35b5a transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6866216 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708664.182688:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789708664.182698:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789708664.182921:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+8:9674:x1876645415762048:12345-192.168.202.53@tcp:36:chmod.0 Request processed in 1770us (1919us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789708664.182932:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 16 00010000:00010000:0.0:1789708664.184669:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6866216 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.184693:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6866216 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.184700:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6866216 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.184706:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708664.184711:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6866216 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.184718:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6866216 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.184748:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38a00) 00010000:00010000:0.0:1789708664.184752:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789708664.184758:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6866216 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.184764:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6866216 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708664.199110:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708664.199198:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415762176 00000100:00100000:1.0:1789708664.199209:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415762176 00000100:00100000:1.0:1789708664.199271:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:1.0:1789708664.199281:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+7:9675:x1876645415762176:12345-192.168.202.53@tcp:101:chown.0 00010000:00010000:1.0:1789708664.199305:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708664.199347:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4e00/0xa8f741d1c686621d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d47d0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.199416:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866224 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.199429:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866224 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.199438:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866224 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708664.199473:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789708664.199477:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789708664.199509:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866224 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.199554:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4e00/0xa8f741d1c686621d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47d0 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.199572:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866224 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47d0 expref: 8 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.199581:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14033c4400) 00010000:00010000:1.0:1789708664.199584:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708664.199588:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5200, rc 0) 00000100:00100000:1.0:1789708664.199749:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+8:9675:x1876645415762176:12345-192.168.202.53@tcp:101:chown.0 Request processed in 468us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708664.199758:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:2.0:1789708664.202482:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708664.202623:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415762304 00000100:00100000:1.0:1789708664.202633:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415762304 00000100:00100000:1.0:1789708664.202712:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:1.0:1789708664.202722:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+8:9675:x1876645415762304:12345-192.168.202.53@tcp:101:chown.0 00010000:00010000:1.0:1789708664.202742:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708664.202760:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c686622b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d47d7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.202818:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866232 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.202831:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866232 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.202842:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866232 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.202869:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866239 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.202877:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866239 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.202883:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866239 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.202970:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866240 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.202978:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.202984:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708664.203011:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789708664.203015:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789708664.203029:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.203041:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866232 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.203047:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866232 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.203054:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866232 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.203070:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708664.203074:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866232 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.203082:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866232 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.203094:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14033c4400) 00010000:00010000:1.0:1789708664.203097:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708664.203101:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866232 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.203107:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866232 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.203119:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866239 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.203126:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866239 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.203131:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866239 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.203136:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5a00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708664.203139:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866239 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.203144:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866239 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.203162:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a14033c4e00) 00010000:00010000:1.0:1789708664.203164:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708664.203167:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866239 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.203173:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866239 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.203201:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c686622b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47d7 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.203215:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866240 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47d7 expref: 9 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.203222:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a14033c4100) 00010000:00010000:1.0:1789708664.203224:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708664.203227:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4c00, rc 0) 00000100:00100000:1.0:1789708664.203288:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+9:9675:x1876645415762304:12345-192.168.202.53@tcp:101:chown.0 Request processed in 566us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708664.203296:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:0.0:1789708664.205733:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708664.205769:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415762560 00000100:00100000:1.0:1789708664.205776:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415762560 00000100:00100000:1.0:1789708664.205818:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:1.0:1789708664.205824:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+9:9675:x1876645415762560:12345-192.168.202.53@tcp:36:chown.0 00010000:00010000:1.0:1789708664.205865:0:7140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708664.205886:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866240 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47d7 expref: 9 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.205911:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a14033c4100) 00010000:00010000:1.0:1789708664.205921:0:7140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708664.205943:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4e00/0xa8f741d1c6866247 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.205955:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4e00/0xa8f741d1c6866247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.205964:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4e00/0xa8f741d1c6866247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789708664.234871:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1789708664.234959:0:7140:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000032c7ff9 reply state 0000000085ea9381 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4e00/0xa8f741d1c6866247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708664.234972:0:7140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789708664.234987:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:1.0:1789708664.235182:0:7140:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789708664.235200:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+7:9675:x1876645415762560:12345-192.168.202.53@tcp:36:chown.0 Request processed in 29370us (29471us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789708664.235209:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00010000:00010000:0.0:1789708664.235359:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4e00/0xa8f741d1c6866247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.235371:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4e00/0xa8f741d1c6866247 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.235380:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4e00/0xa8f741d1c6866247 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.235403:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708664.235408:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4e00/0xa8f741d1c6866247 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.235416:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4e00/0xa8f741d1c6866247 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.235434:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:0.0:1789708664.235437:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789708664.235441:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4e00/0xa8f741d1c6866247 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.235447:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4e00/0xa8f741d1c6866247 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708664.250128:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708664.250556:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415762688 00000100:00100000:1.0:1789708664.250567:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415762688 00000100:00100000:1.0:1789708664.250636:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:1.0:1789708664.250646:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:9676:x1876645415762688:12345-192.168.202.53@tcp:101:touch.500 00010000:00010000:3.0:1789708664.250895:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708664.250919:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c686624e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d47de expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789708664.252882:0:5820:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1909us 00010000:00010000:1.0:1789708664.263430:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866255 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.263451:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866255 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.263470:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866255 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.263485:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c686625c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.263492:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c686625c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.263499:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c686625c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.263837:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866263 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.263847:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.263855:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708664.263877:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789708664.263881:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789708664.263917:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.263929:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866255 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.263937:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866255 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.263954:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866255 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.263961:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708664.263965:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866255 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.263973:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866255 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.263986:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14033c4400) 00010000:00010000:1.0:1789708664.263990:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708664.263995:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866255 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.264001:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866255 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.264012:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c686625c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.264019:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c686625c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.264025:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c686625c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.264031:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708664.264033:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c686625c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.264049:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c686625c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.264057:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a14033c4500) 00010000:00010000:1.0:1789708664.264060:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708664.264063:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c686625c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.264069:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c686625c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.264108:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c686624e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47de expref: 8 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.264125:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866263 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47de expref: 7 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.264133:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a14033c4e00) 00010000:00010000:1.0:1789708664.264135:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789708664.264137:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5a00, rc 0) 00000100:00100000:1.0:1789708664.264209:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+7:9676:x1876645415762688:12345-192.168.202.53@tcp:101:touch.500 Request processed in 13563us (14090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708664.264219:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:0.0:1789708664.267855:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708664.268012:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415762944 00000100:00100000:1.0:1789708664.268024:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415762944 00000100:00100000:1.0:1789708664.268113:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:1.0:1789708664.268124:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+7:9676:x1876645415762944:12345-192.168.202.53@tcp:101:touch.500 00010000:00010000:1.0:1789708664.268162:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708664.268182:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686626a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d47e5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.268459:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6866271 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.268476:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6866271 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.268486:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6866271 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.268540:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866278 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.268549:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.268556:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789708664.269316:0:5819:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789708664.269588:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c686627f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.269600:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c686627f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.269609:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c686627f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.269673:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6866271 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.269681:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6866271 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.269688:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6866271 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.269695:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708664.269700:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6866271 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.269708:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6866271 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.269720:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a14033c4e00) 00010000:00010000:1.0:1789708664.269723:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708664.269728:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6866271 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.269734:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6866271 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708664.269748:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045e72bda reply state 000000003e8ad75f transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708664.269756:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789708664.269786:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686626a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47e5 expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.269812:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c686627f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47e5 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.269820:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a14033c4d00) 00010000:00010000:1.0:1789708664.269823:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708664.269825:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4a00, rc 0) 00000100:00100000:1.0:1789708664.269900:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+10:9676:x1876645415762944:12345-192.168.202.53@tcp:101:touch.500 Request processed in 1778us (2055us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789708664.269910:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 21 00010000:00010000:0.0:1789708664.271725:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.271755:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866278 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.271763:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866278 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.271769:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708664.271773:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866278 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.271793:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866278 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.271810:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9a0eeda8 (ffff8a14033c4100) 00010000:00010000:0.0:1789708664.271813:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708664.271818:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866278 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.271825:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866278 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708664.275164:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708664.275239:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415763200 00000100:00100000:2.0:1789708664.275255:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415763200 00000100:00100000:2.0:1789708664.275306:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:2.0:1789708664.275313:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+9:9676:x1876645415763200:12345-192.168.202.53@tcp:36:touch.500 00010000:00010000:2.0:1789708664.275381:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708664.275407:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c686627f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47e5 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.275423:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a14033c4d00) 00010000:00010000:2.0:1789708664.275433:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708664.275473:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686628d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.275486:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686628d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.275495:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686628d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789708664.275847:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4093eb6 reply state 00000000e19548dc transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686628d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708664.275857:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789708664.275992:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+10:9676:x1876645415763200:12345-192.168.202.53@tcp:36:touch.500 Request processed in 677us (834us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789708664.276000:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 22 00010000:00010000:0.0:1789708664.277736:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686628d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.277752:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686628d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.277760:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686628d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.277766:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708664.277771:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686628d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.277779:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686628d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.277793:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a1414c38000) 00010000:00010000:0.0:1789708664.277797:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708664.277814:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686628d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.277820:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686628d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708664.278414:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708664.278486:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415763328 00000100:00100000:1.0:1789708664.278494:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415763328 00000100:00100000:1.0:1789708664.278547:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:1.0:1789708664.278557:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+9:9676:x1876645415763328:12345-192.168.202.53@tcp:101:touch.500 00010000:00010000:1.0:1789708664.278580:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708664.278612:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866294 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d47ec expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.278684:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866294 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47ec expref: 10 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.278694:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866294 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47ec expref: 10 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.278707:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a14033c4500) 00010000:00010000:1.0:1789708664.278710:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708664.278718:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4400, rc 0) 00000100:00100000:1.0:1789708664.278766:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+10:9676:x1876645415763328:12345-192.168.202.53@tcp:101:touch.500 Request processed in 211us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708664.278773:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:3.0:1789708664.281389:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708664.281683:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415763456 00000100:00100000:1.0:1789708664.281692:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415763456 00000100:00100000:1.0:1789708664.281728:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:1.0:1789708664.281733:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a141080b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1876645415763456:12345-192.168.202.53@tcp:8:touch.500 00010000:00080000:1.0:1789708664.281763:0:6673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:1.0:1789708664.281794:0:6673:0:(genops.c:1384:class_connect()) connect: client 14bb7f14-3461-47f6-86c9-db3f545050ad, cookie 0xa8f741d1c686629b 00002000:00100000:1.0:1789708664.281805:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 14bb7f14-3461-47f6-86c9-db3f545050ad/ffff8a140318f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789708664.281824:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789708664.282018:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789708664.282044:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8a13069bd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708664.282096:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a141080b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2360:x1876645415763456:12345-192.168.202.53@tcp:8:touch.500 Request processed in 361us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708664.282103:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:2.0:1789708664.284438:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708664.287688:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415763584 00000100:00100000:1.0:1789708664.287704:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415763584 00000100:00100000:1.0:1789708664.287905:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:1.0:1789708664.287916:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143facb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+6:0:x1876645415763584:12345-192.168.202.53@tcp:2:touch.500 00000100:00080000:2.0:1789708664.288243:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789708664.329437:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1789708664.329473:0:7627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14bb7f14-3461-47f6-86c9-db3f545050ad 00000100:00100000:2.0:1789708664.329548:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143facb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+5:0:x1876645415763584:12345-192.168.202.53@tcp:2:touch.500 Request processed in 41626us (45109us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789708664.329561:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:0.0:1789708664.332345:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708664.332603:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415763840 00000100:00100000:3.0:1789708664.332613:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415763840 00000100:00100000:3.0:1789708664.332693:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:3.0:1789708664.332703:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+10:9676:x1876645415763840:12345-192.168.202.53@tcp:35:touch.500 00000100:00100000:3.0:1789708664.333296:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+11:9676:x1876645415763840:12345-192.168.202.53@tcp:35:touch.500 Request processed in 593us (969us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789708664.333305:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:3.0:1789708664.342393:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708664.342461:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415763968 00000100:00100000:1.0:1789708664.342469:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415763968 00000100:00100000:1.0:1789708664.342592:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:1.0:1789708664.342601:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a141080aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+11:9677:x1876645415763968:12345-192.168.202.53@tcp:101:rm.0 00010000:00010000:1.0:1789708664.342622:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708664.342696:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c68662a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d47f3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.342754:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c68662a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.342766:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c68662a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.342777:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c68662a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708664.342809:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789708664.342813:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789708664.342865:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c68662a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.342897:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c68662a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47f3 expref: 13 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.342914:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c68662a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47f3 expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.342922:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a14033c4e00) 00010000:00010000:1.0:1789708664.342925:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708664.342929:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5400, rc 0) 00000100:00100000:1.0:1789708664.343191:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a141080aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+12:9677:x1876645415763968:12345-192.168.202.53@tcp:101:rm.0 Request processed in 589us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708664.343199:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:2.0:1789708664.357432:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708664.357532:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415764224 00000100:00100000:1.0:1789708664.357557:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415764224 00000100:00100000:1.0:1789708664.357618:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:1.0:1789708664.357628:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143faca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+12:9677:x1876645415764224:12345-192.168.202.53@tcp:101:rm.0 00010000:00010000:1.0:1789708664.357690:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708664.357713:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c68662b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d47fa expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708664.357804:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789708664.357984:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c68662b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47fa expref: 14 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.358010:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14033c4400) 00010000:00010000:1.0:1789708664.358013:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708664.358019:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c68662b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47fa expref: 14 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.358036:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5600, rc 0) 00000100:00100000:1.0:1789708664.358097:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143faca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+13:9677:x1876645415764224:12345-192.168.202.53@tcp:101:rm.0 Request processed in 470us (674us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1789708664.358105:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:0.0:1789708664.360901:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708664.362287:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415764352 00000100:00100000:1.0:1789708664.362301:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415764352 00000100:00100000:1.0:1789708664.362370:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:1.0:1789708664.362382:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+13:9677:x1876645415764352:12345-192.168.202.53@tcp:37:rm.0 00000100:00100000:0.0:1789708664.369700:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+13:9677:x1876645415764352:12345-192.168.202.53@tcp:37:rm.0 Request processed in 7310us (8796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708664.369713:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:2.0:1789708664.376243:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708664.376465:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415764608 00000100:00100000:3.0:1789708664.376475:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415764608 00000100:00100000:3.0:1789708664.376530:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:3.0:1789708664.376541:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14069f8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+13:9677:x1876645415764608:12345-192.168.202.53@tcp:35:rm.0 00000100:00100000:3.0:1789708664.376817:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14069f8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+14:9677:x1876645415764608:12345-192.168.202.53@tcp:35:rm.0 Request processed in 278us (583us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789708664.376825:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:1.0:1789708664.380433:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708664.380507:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415764864 00000100:00100000:2.0:1789708664.380517:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415764864 00000100:00100000:2.0:1789708664.380575:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 26 00000100:00100000:2.0:1789708664.380587:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+14:9677:x1876645415764864:12345-192.168.202.53@tcp:101:rm.0 00010000:00010000:2.0:1789708664.380611:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708664.380643:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c68662be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4801 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.380893:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68662c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.380908:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68662c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.380918:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68662c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708664.380930:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789708664.381115:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c68662be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4801 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.381133:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68662c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4801 expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.381142:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a14033c4e00) 00010000:00010000:2.0:1789708664.381145:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789708664.381149:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6a600, rc 0) 00000100:00100000:2.0:1789708664.381207:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+16:9677:x1876645415764864:12345-192.168.202.53@tcp:101:rm.0 Request processed in 623us (781us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789708664.381220:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 26 00000100:00100000:2.0:1789708664.385909:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708664.389982:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415764992 00000100:00100000:0.0:1789708664.389998:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415764992 00000100:00100000:0.0:1789708664.390072:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:0.0:1789708664.390085:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+16:9677:x1876645415764992:12345-192.168.202.53@tcp:41:rm.0 00000004:00000024:0.0:1789708664.390145:0:5819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789708664.390220:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+16:9677:x1876645415764992:12345-192.168.202.53@tcp:41:rm.0 Request processed in 137us (4320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708664.390228:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:0.0:1789708664.392948:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708664.395519:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415765120 00000100:00100000:1.0:1789708664.395535:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415765120 00000100:00100000:1.0:1789708664.395753:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:1.0:1789708664.395765:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+16:9677:x1876645415765120:12345-192.168.202.53@tcp:101:rm.0 00010000:00010000:1.0:1789708664.395787:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708664.395815:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5e00/0xa8f741d1c68662d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4808 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396039:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68662da lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396056:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68662da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396069:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68662da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396086:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c68662e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396094:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c68662e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396101:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c68662e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396200:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68662e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396209:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68662e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396216:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68662e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708664.396256:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789708664.396261:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789708664.396278:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68662e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396290:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68662e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396298:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68662da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396305:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68662da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396311:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68662da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396317:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708664.396322:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68662da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396341:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68662da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396352:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a14033c4e00) 00010000:00010000:1.0:1789708664.396355:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708664.396360:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68662da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396366:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68662da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396390:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c68662e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396396:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c68662e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396402:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c68662e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396407:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708664.396411:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c68662e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396417:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c68662e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396424:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9a0eeda8 (ffff8a14033c4b00) 00010000:00010000:1.0:1789708664.396427:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708664.396429:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c68662e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396435:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c68662e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396463:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5e00/0xa8f741d1c68662d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4808 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396476:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68662e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4808 expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.396493:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a14033c4500) 00010000:00010000:1.0:1789708664.396495:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708664.396498:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4200, rc 0) 00000100:00100000:1.0:1789708664.396606:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+17:9677:x1876645415765120:12345-192.168.202.53@tcp:101:rm.0 Request processed in 843us (3664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708664.396613:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:1.0:1789708664.399273:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708664.399361:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415765376 00000100:00100000:0.0:1789708664.399372:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415765376 00000100:00100000:0.0:1789708664.399424:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:0.0:1789708664.399434:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+17:9677:x1876645415765376:12345-192.168.202.53@tcp:36:rm.0 00010000:00010000:0.0:1789708664.399493:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789708664.399519:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68662e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4808 expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.399561:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866294 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47ec expref: 16 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.399572:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a14033c4500) 00010000:00010000:0.0:1789708664.399588:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c68662a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47f3 expref: 15 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.399597:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a14033c4e00) 00010000:00010000:0.0:1789708664.399600:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708664.399621:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400030c00/0xa8f741d1c68662ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.399633:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400030c00/0xa8f741d1c68662ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.399642:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400030c00/0xa8f741d1c68662ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.399701:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68662f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.399709:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68662f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.399716:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68662f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.399867:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c68662fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.399885:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c68662fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.399902:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c68662fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708664.400642:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789708664.400676:0:5819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 230198025153ns, next at 231198022028ns, rc = 0 00010000:00010000:1.0:1789708664.400778:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866304 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.400791:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866304 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.400800:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866304 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.400807:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866304 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.400813:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866304 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.400820:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866304 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.400846:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708664.400864:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c68662fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.400871:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c68662fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.400896:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c68662fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.400901:0:8433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708664.400903:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a9200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708664.400911:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866304 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.400920:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4c00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708664.400924:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866304 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.400933:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866304 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.400955:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a14148f3400) 00010000:00010000:3.0:1789708664.400966:0:8433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789708664.400971:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866304 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.400977:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866304 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708664.400989:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708664.400991:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708664.400993:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708664.401018:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c68662fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.401027:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c68662fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.401035:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a14148f3400) 00010000:00010000:1.0:1789708664.401038:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789708664.401041:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c68662fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.401046:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c68662fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.401066:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400030c00/0xa8f741d1c68662ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.401073:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400030c00/0xa8f741d1c68662ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.401079:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400030c00/0xa8f741d1c68662ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.401084:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400030c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708664.401086:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400030c00/0xa8f741d1c68662ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.401113:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400030c00/0xa8f741d1c68662ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.401122:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a14033c4e00) 00010000:00010000:1.0:1789708664.401125:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708664.401128:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400030c00/0xa8f741d1c68662ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.401134:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400030c00/0xa8f741d1c68662ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708664.401145:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a45454b7 reply state 00000000de3f6e3a transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68662f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708664.401154:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789708664.401243:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+16:9677:x1876645415765376:12345-192.168.202.53@tcp:36:rm.0 Request processed in 1809us (1977us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789708664.401252:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:2.0:1789708664.406677:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00010000:00010000:0.0:1789708664.406797:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68662f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708664.406809:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415765632 00010000:00010000:0.0:1789708664.406811:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68662f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708664.406821:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415765632 00010000:00010000:0.0:1789708664.406822:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68662f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.406831:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a8800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708664.406837:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68662f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.406845:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68662f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.406862:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9a0eeda8 (ffff8a14148f3500) 00010000:00010000:0.0:1789708664.406865:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708664.406870:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68662f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.406877:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68662f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9a0eeda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708664.406882:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:3.0:1789708664.406898:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+16:9677:x1876645415765632:12345-192.168.202.53@tcp:35:rm.0 00000100:00100000:3.0:1789708664.407431:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+16:9677:x1876645415765632:12345-192.168.202.53@tcp:35:rm.0 Request processed in 537us (789us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789708664.407441:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:1.0:1789708664.412474:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708664.412547:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415765888 00000100:00100000:2.0:1789708664.412557:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415765888 00000100:00100000:2.0:1789708664.412625:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:2.0:1789708664.412636:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+16:9677:x1876645415765888:12345-192.168.202.53@tcp:36:rm.0 00010000:00010000:2.0:1789708664.412718:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789708664.412746:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68662c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4801 expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.412768:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866263 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47de expref: 15 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.412779:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a14033c4e00) 00010000:00010000:2.0:1789708664.412794:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866224 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47d0 expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.412803:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14033c4400) 00010000:00010000:2.0:1789708664.412809:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708664.412833:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c686630b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.412845:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c686630b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.412855:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c686630b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.412878:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866312 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.412883:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866312 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.412888:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866312 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.413087:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c6866319 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.413092:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c6866319 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.413097:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c6866319 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708664.413547:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789708664.413562:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c6866319 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.413569:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c6866319 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.413575:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c6866319 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.413581:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708664.413586:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c6866319 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.413605:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c6866319 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.413614:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a1414c38b00) 00010000:00010000:2.0:1789708664.413616:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789708664.413619:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c6866319 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.413623:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c6866319 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.413641:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c686630b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.413647:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c686630b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.413696:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c686630b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.413700:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6aa00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708664.413703:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c686630b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.413707:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c686630b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.413712:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38700) 00010000:00010000:2.0:1789708664.413714:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708664.413716:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c686630b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708664.413727:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c686630b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789708664.413736:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abfe33d7 reply state 0000000076b09a5c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866312 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708664.413741:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789708664.413817:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+15:9677:x1876645415765888:12345-192.168.202.53@tcp:36:rm.0 Request processed in 1181us (1350us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789708664.413827:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 30 00010000:00010000:1.0:1789708664.415176:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866312 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.415190:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866312 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.415197:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866312 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.415203:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6ba00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708664.415206:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866312 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.415234:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866312 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.415248:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a1414c38d00) 00010000:00010000:1.0:1789708664.415251:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708664.415256:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866312 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708664.415262:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866312 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708664.966794:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708665.084258:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708665.084297:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708665.084338:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415766144 00000100:00100000:3.0:1789708665.084349:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415766144 00000100:00100000:3.0:1789708665.084418:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:3.0:1789708665.084429:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c9d2a103-cf70-4470-bdd0-387470668318+5:2364:x1876645415766144:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708665.084546:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c9d2a103-cf70-4470-bdd0-387470668318+5:2364:x1876645415766144:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 118us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708665.084553:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:0.0:1789708665.084796:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415766016 00000100:00100000:0.0:1789708665.084801:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415766016 00000100:00100000:0.0:1789708665.084906:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 228 00000100:00100000:0.0:1789708665.084914:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2364:x1876645415766016:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708665.084950:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2364:x1876645415766016:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 37us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708665.084957:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 228 00000100:00080000:1.0:1789708665.086036:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708665.093878:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708665.093915:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708665.093945:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415766272 00000100:00100000:3.0:1789708665.093955:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415766272 00000100:00100000:3.0:1789708665.094019:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415766400 00000100:00100000:3.0:1789708665.094023:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415766400 00000100:00100000:3.0:1789708665.094047:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:3.0:1789708665.094057:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a141080a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c9d2a103-cf70-4470-bdd0-387470668318+5:2360:x1876645415766272:12345-192.168.202.53@tcp:9:kworker.0 00000020:00000080:3.0:1789708665.094087:0:10424:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c68661ad 00000100:00080000:3.0:1789708665.094096:0:10424:0:(import.c:65:import_set_state_nolock()) ffff8a14345ef800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789708665.094136:0:10424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789708665.094499:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a141080a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c9d2a103-cf70-4470-bdd0-387470668318+2:2360:x1876645415766272:12345-192.168.202.53@tcp:9:kworker.0 Request processed in 441us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708665.094507:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:3.0:1789708665.094525:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:3.0:1789708665.094532:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c9d2a103-cf70-4470-bdd0-387470668318+5:2360:x1876645415766400:12345-192.168.202.53@tcp:9:kworker.0 00000020:00000080:3.0:1789708665.094546:0:10424:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c68661b4 00000100:00080000:3.0:1789708665.094552:0:10424:0:(import.c:65:import_set_state_nolock()) ffff8a14345ee800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789708665.094576:0:10424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789708665.094813:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c9d2a103-cf70-4470-bdd0-387470668318+2:2360:x1876645415766400:12345-192.168.202.53@tcp:9:kworker.0 Request processed in 280us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708665.094820:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00010000:00010000:3.0:1789708665.094848:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708665.094855:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789708665.094862:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789708665.094867:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789708665.978886:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708666.106894:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708666.106918:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143ec30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426275712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708666.106987:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708666.107119:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426275712 00000100:00100000:2.0:1789708666.107127:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426275712 00000100:00100000:2.0:1789708666.107213:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789708666.107223:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426275712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789708666.107256:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789708666.107301:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426275712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708666.107321:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789708666.107360:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143ec30000 x1876645426275712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708666.107377:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143ec30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426275712:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789708666.107418:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1789708666.477192:0:11589:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:1.0:1789708666.618847:0:7748:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 232416194068ns, next at 233416191202ns, rc = 0 00000100:00100000:1.0:1789708666.618870:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789708666.618889:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fa05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426275840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708666.618954:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708666.619214:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426275840 00000100:00100000:1.0:1789708666.619221:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143ec30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426275968:0@lo:400:kworker.0 00000100:00100000:0.0:1789708666.619222:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426275840 00000100:00100000:1.0:1789708666.619263:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708666.619291:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876645426276480:0@lo:400:kworker.0 00000100:00100000:1.0:1789708666.619332:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708666.619349:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789708666.619358:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426276352:0@lo:400:kworker.0 00000100:00100000:0.0:1789708666.619364:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426275840:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708666.619374:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426275968 00000100:00100000:1.0:1789708666.619379:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426275968 00000100:00100000:2.0:1789708666.619403:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789708666.619405:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708666.619416:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789708666.619427:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3287:x1876645426275968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708666.619446:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426276096:0@lo:400:kworker.0 00000100:00100000:0.0:1789708666.619464:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426275840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708666.619476:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789708666.619478:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3287:x1876645426275968:12345-0@lo:400:kworker.0 Request processed in 49us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708666.619491:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708666.619499:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789708666.619520:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789708666.619529:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426276224:0@lo:400:kworker.0 00000100:00100000:1.0:1789708666.619538:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426276480 00000100:00080000:3.0:1789708666.619541:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708666.619544:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426276480 00000100:00100000:2.0:1789708666.619557:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789708666.619563:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708666.619597:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426276352 00000100:00100000:2.0:1789708666.619602:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426276352 00000100:00100000:2.0:1789708666.619640:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789708666.619671:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143facbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426276352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708666.619722:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143facbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426276352:12345-0@lo:400:kworker.0 Request processed in 76us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708666.619730:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789708666.619771:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143f512300 x1876645426276352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708666.619784:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426276352:0@lo:400:kworker.0 00000100:00100000:1.0:1789708666.620873:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426276096 00000100:00100000:1.0:1789708666.620880:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426276096 00000100:00100000:3.0:1789708666.620888:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426276224 00000100:00100000:3.0:1789708666.620894:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426276224 00000100:00100000:0.0:1789708666.620905:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789708666.620914:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789708666.620920:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876645426276480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708666.620925:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426276096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708666.620934:0:5819:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789708666.620942:0:5819:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1789708666.620953:0:5821:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00080000:3.0:1789708666.620962:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708666.620968:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789708666.620983:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143facaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426276224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708666.620983:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426276096:12345-0@lo:400:kworker.0 Request processed in 59us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708666.620993:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876645426276480:12345-0@lo:400:kworker.0 Request processed in 76us (1659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708666.620998:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789708666.621008:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789708666.621033:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143facaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426276224:12345-0@lo:400:kworker.0 Request processed in 56us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708666.621042:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789708666.621114:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426276224:0@lo:400:kworker.0 00000100:00100000:1.0:1789708666.621126:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426276096:0@lo:400:kworker.0 00000100:00100000:1.0:1789708666.621153:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143ec30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426275968:0@lo:400:kworker.0 00000100:00100000:1.0:1789708666.621165:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876645426276480:0@lo:400:kworker.0 00010000:00080000:1.0:1789708666.621173:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143fa05180 x1876645426275840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708666.621184:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fa05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426275840:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789708667.015249:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789708667.043188:0:11638:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6fc0a650 20000000:00000080:2.0:1789708667.043207:0:11638:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a143efc8000 uarg=0000000000000000 20000000:01000000:2.0:1789708667.043247:0:11638:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789708667.043253:0:11638:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789708667.043258:0:11638:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789708667.044046:0:11639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1789708667.044189:0:11638:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789708667.049380:0:11638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789708667.049451:0:11638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1789708667.049503:0:11638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1789708667.049524:0:11638:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789708667.049546:0:11638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6866320 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.049562:0:11638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1400031000/0xa8f741d1c68661c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c68661c2 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.049570:0:11638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1400030000/0xa8f741d1c68661d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c68661d0 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.049577:0:11638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a143efc5800/0xa8f741d1c68661e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c68661de expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.049586:0:11638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1400030800/0xa8f741d1c68661ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47bb expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.049593:0:11638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1400031e00/0xa8f741d1c68661f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47c2 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.049601:0:11638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6866320 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.049641:0:11638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1400031e00/0xa8f741d1c68661f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47c2 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.049831:0:11638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1400031e00/0xa8f741d1c68661f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47c2 expref: 12 pid: 5814 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708667.049847:0:11638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fac8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876645426276608:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708667.049951:0:11638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1400030800/0xa8f741d1c68661ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47bb expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.049970:0:11638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1400030800/0xa8f741d1c68661ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47bb expref: 12 pid: 5813 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708667.049979:0:11638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fac9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876645426276736:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708667.050013:0:11638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a143efc5800/0xa8f741d1c68661e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c68661de expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050021:0:11638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a143efc5800/0xa8f741d1c68661e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c68661de expref: 18 pid: 5814 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708667.050029:0:11638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143facad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876645426276864:0@lo:104: 00000100:00100000:2.0:1789708667.050068:0:11638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708667.050110:0:11638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1400030000/0xa8f741d1c68661d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c68661d0 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050119:0:11638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1400030000/0xa8f741d1c68661d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c68661d0 expref: 18 pid: 5813 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708667.050127:0:11638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143faca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876645426276992:0@lo:104: 00000100:00100000:2.0:1789708667.050148:0:11638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708667.050177:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426276864 00000100:00100000:2.0:1789708667.050184:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426276864 00000100:00100000:2.0:1789708667.050217:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426276992 00000100:00100000:2.0:1789708667.050220:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426276992 00000100:00100000:2.0:1789708667.050234:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789708667.050241:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+4:11638:x1876645426276864:12345-0@lo:104: 00010000:00010000:2.0:1789708667.050254:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c68661de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c68661e5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050318:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789708667.050324:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+4:11638:x1876645426276864:12345-0@lo:104: Request processed in 84us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708667.050332:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789708667.050350:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789708667.050357:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:11638:x1876645426276992:12345-0@lo:104: 00010000:00010000:2.0:1789708667.050365:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c68661d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c68661d7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050398:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789708667.050403:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:11638:x1876645426276992:12345-0@lo:104: Request processed in 48us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708667.050409:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789708667.050438:0:11638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1400031000/0xa8f741d1c68661c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c68661c2 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050447:0:11638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1400031000/0xa8f741d1c68661c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c68661c2 expref: 18 pid: 5813 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708667.050456:0:11638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876645426277120:0@lo:104: 00000100:00100000:2.0:1789708667.050482:0:11638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708667.050511:0:5803:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789708667.050521:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426277120 00000100:00100000:2.0:1789708667.050525:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426277120 00000100:00100000:2.0:1789708667.050542:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789708667.050548:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306e57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:11638:x1876645426277120:12345-0@lo:104: 00010000:00010000:2.0:1789708667.050556:0:5803:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c68661c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c68661c9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050592:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789708667.050598:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306e57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+3:11638:x1876645426277120:12345-0@lo:104: Request processed in 50us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708667.050604:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789708667.050645:0:11638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14051023c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708667.050693:0:11638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143facad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876645426276864:0@lo:104: 00000100:00100000:2.0:1789708667.050701:0:11638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143faca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876645426276992:0@lo:104: 00000100:00100000:2.0:1789708667.050707:0:11638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876645426277120:0@lo:104: 00010000:00010000:2.0:1789708667.050736:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789708667.050742:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c68661de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c68661e5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050750:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38600 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:2.0:1789708667.050754:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c68661de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c68661e5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050762:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c68661de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c68661e5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708667.050769:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c68661de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c68661e5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708667.050775:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789708667.050799:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c68661de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c68661e5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050806:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708667.050825:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c68661de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c68661e5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050839:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c68661de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c68661e5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050852:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789708667.050855:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c68661d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c68661d7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050862:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38800 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:2.0:1789708667.050865:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c68661d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c68661d7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050872:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c68661d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c68661d7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708667.050879:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c68661d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c68661d7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708667.050884:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789708667.050898:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c68661d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c68661d7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050904:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708667.050911:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c68661d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c68661d7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050918:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c68661d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c68661d7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050926:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708667.050934:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c68661c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c68661c9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050940:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38000 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:2.0:1789708667.050943:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c68661c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c68661c9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050951:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c68661c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c68661c9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708667.050957:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c68661c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c68661c9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708667.050962:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789708667.050975:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c68661c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c68661c9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.050980:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789708667.050993:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c68661c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c68661c9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.051000:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c68661c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c68661c9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.051010:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708667.051012:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708667.051014:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708667.051020:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708667.051030:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426277248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708667.051057:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708667.051077:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789708667.051088:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426277376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708667.051108:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708667.051136:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426277248 00000100:00100000:2.0:1789708667.051140:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426277248 00010000:00010000:2.0:1789708667.051156:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a143efc5800/0xa8f741d1c68661e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c68661de expref: 19 pid: 5814 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708667.051173:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426277376 00000100:00100000:2.0:1789708667.051175:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426277376 00010000:00010000:2.0:1789708667.051184:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1400030000/0xa8f741d1c68661d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c68661d0 expref: 20 pid: 5813 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708667.051201:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789708667.051208:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+20:3288:x1876645426277248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708667.051217:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708667.051222:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a143efc5800/0xa8f741d1c68661e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c68661de expref: 20 pid: 5814 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.051230:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a143efc5800/0xa8f741d1c68661e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c68661de expref: 20 pid: 5814 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.051241:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143efc5800/0xa8f741d1c68661e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c68661de expref: 20 pid: 5814 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.051252:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708667.051276:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3288:x1876645426277248:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708667.051282:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789708667.051295:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789708667.051316:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:3288:x1876645426277376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708667.051329:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708667.051334:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1400030000/0xa8f741d1c68661d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c68661d0 expref: 18 pid: 5813 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.051342:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1400030000/0xa8f741d1c68661d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c68661d0 expref: 18 pid: 5813 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.051351:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400030000/0xa8f741d1c68661d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c68661d0 expref: 18 pid: 5813 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.051360:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708667.051381:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:3288:x1876645426277376:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708667.051385:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789708667.051413:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426277376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708667.051420:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426277248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708667.051449:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143facb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426277504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708667.051474:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789708667.051496:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708667.051504:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426277504 00000100:00100000:2.0:1789708667.051507:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426277504 00010000:00010000:2.0:1789708667.051519:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1400031000/0xa8f741d1c68661c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c68661c2 expref: 17 pid: 5813 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708667.051535:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789708667.051540:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1408282450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:3286:x1876645426277504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708667.051547:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708667.051555:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1400031000/0xa8f741d1c68661c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c68661c2 expref: 17 pid: 5813 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.051562:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1400031000/0xa8f741d1c68661c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c68661c2 expref: 17 pid: 5813 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.051572:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400031000/0xa8f741d1c68661c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c68661c2 expref: 17 pid: 5813 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.051581:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708667.051604:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1408282450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:3286:x1876645426277504:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708667.051610:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789708667.051675:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143facb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426277504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708667.054870:0:11638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fac8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876645426276608:192.168.202.53@tcp:104: 00000100:00100000:3.0:1789708667.054995:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708667.055073:0:11638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fac9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11638:1876645426276736:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708667.055104:0:11638:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6866320 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708667.055692:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415766528 00000100:00100000:0.0:1789708667.055701:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415766528 00010000:00010000:0.0:1789708667.055734:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1400031e00/0xa8f741d1c68661f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47c2 expref: 13 pid: 5814 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708667.055779:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:0.0:1789708667.055788:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f512300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2362:x1876645415766528:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708667.055805:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708667.055811:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1400031e00/0xa8f741d1c68661f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47c2 expref: 13 pid: 5814 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708667.055823:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1400031e00/0xa8f741d1c68661f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47c2 expref: 13 pid: 5814 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708667.055839:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400031e00/0xa8f741d1c68661f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47c2 expref: 13 pid: 5814 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708667.055855:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708667.055902:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f512300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:2362:x1876645415766528:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 114us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708667.055910:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:0.0:1789708667.057108:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708667.057178:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415766656 00000100:00100000:2.0:1789708667.057184:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415766656 00010000:00010000:2.0:1789708667.057208:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1400030800/0xa8f741d1c68661ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47bb expref: 12 pid: 5813 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708667.057264:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:2.0:1789708667.057274:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:2362:x1876645415766656:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708667.057285:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708667.057290:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1400030800/0xa8f741d1c68661ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47bb expref: 12 pid: 5813 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.057332:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1400030800/0xa8f741d1c68661ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47bb expref: 12 pid: 5813 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.057346:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400030800/0xa8f741d1c68661ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d47bb expref: 12 pid: 5813 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.057361:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6866320 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.057369:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6866320 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.057385:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6866320 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.057391:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6866320 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.057399:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6866320 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.057405:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6866320 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.057411:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6ac00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:2.0:1789708667.057415:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6866320 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.057423:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6866320 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.057456:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6866320 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708667.057467:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708667.057511:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7afaea2d-d635-45b7-851c-2e40ec565b3d+11:2362:x1876645415766656:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 238us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708667.057517:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 34 00010000:00010000:1.0:1789708667.057567:0:11638:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6866320 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708667.057575:0:11638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6866320 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708667.057580:0:11638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1403b6ac00/0xa8f741d1c6866320 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1789708667.677859:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c9d2a103-cf70-4470-bdd0-387470668318 00000020:00000080:0.0:1789708667.677870:0:6697:0:(genops.c:885:class_export_put()) final put ffff8a14345ec000/c9d2a103-cf70-4470-bdd0-387470668318 00000020:00000080:1.0:1789708667.677941:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a14345ec000/c9d2a103-cf70-4470-bdd0-387470668318 for lustre-OST0000 00000020:00000080:1.0:1789708667.677990:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a14345ef800 for lustre-OST0000 00010000:00010000:0.0:1789708668.027469:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708668.219142:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708668.221821:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415766784 00000100:00100000:0.0:1789708668.221836:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415766784 00000100:00100000:0.0:1789708668.221911:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 230 00000100:00100000:0.0:1789708668.221933:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+11:5595:x1876645415766784:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708668.221949:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708668.221964:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a14014a8200/0xa8f741d1c6866327 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d480f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708668.222000:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a14014a8200/0xa8f741d1c6866327 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d480f expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708668.222011:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a14014a8200/0xa8f741d1c6866327 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d480f expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708668.222021:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14014a8200, rc 0) 00000100:00100000:0.0:1789708668.222087:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:5595:x1876645415766784:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 155us (2955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708668.222091:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 230 00000100:00100000:3.0:1789708668.229968:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708668.230149:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415766912 00000100:00100000:1.0:1789708668.230160:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415766912 00000100:00100000:1.0:1789708668.230219:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 231 00000100:00100000:1.0:1789708668.230228:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:5595:x1876645415766912:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708668.230552:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:5595:x1876645415766912:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 324us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708668.230561:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 231 00000100:00100000:0.0:1789708668.238612:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708668.238687:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415767040 00000100:00100000:1.0:1789708668.238698:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415767040 00000100:00100000:1.0:1789708668.238756:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 232 00000100:00100000:1.0:1789708668.238766:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:5595:x1876645415767040:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708668.238997:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:5595:x1876645415767040:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 Request processed in 232us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708668.239005:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 232 00000100:00100000:3.0:1789708668.244910:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708668.245006:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415767168 00000100:00100000:0.0:1789708668.245016:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415767168 00000100:00100000:0.0:1789708668.245069:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 233 00000100:00100000:0.0:1789708668.245079:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:9946:x1876645415767168:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789708668.245318:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:9946:x1876645415767168:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 237us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708668.245327:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 233 00000100:00100000:3.0:1789708668.246809:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708668.248783:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415767296 00000100:00100000:1.0:1789708668.248798:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415767296 00000100:00100000:1.0:1789708668.248890:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 234 00000100:00100000:1.0:1789708668.248901:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:9946:x1876645415767296:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789708668.249168:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:9946:x1876645415767296:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 267us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708668.249177:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 234 00000100:00100000:2.0:1789708668.257937:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708668.263420:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415767424 00000100:00100000:0.0:1789708668.263436:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415767424 00000100:00100000:0.0:1789708668.263518:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 235 00000100:00100000:0.0:1789708668.263540:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:5595:x1876645415767424:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708668.263576:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708668.263603:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a14014a8000/0xa8f741d1c686632e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4816 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708668.263634:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a14014a8000/0xa8f741d1c686632e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4816 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708668.263646:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a14014a8000/0xa8f741d1c686632e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4816 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708668.263669:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14014a8000, rc 0) 00000100:00100000:0.0:1789708668.263746:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:5595:x1876645415767424:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 219us (5822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708668.263753:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 235 00000100:00100000:3.0:1789708668.266889:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708668.267028:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415767552 00000100:00100000:0.0:1789708668.267039:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415767552 00000100:00100000:0.0:1789708668.267101:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 236 00000100:00100000:0.0:1789708668.267112:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:5595:x1876645415767552:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708668.267420:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:5595:x1876645415767552:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 308us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708668.267428:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 236 00000100:00100000:3.0:1789708668.270243:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708668.270424:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415767680 00000100:00100000:0.0:1789708668.270435:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415767680 00000100:00100000:0.0:1789708668.270535:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 237 00000100:00100000:0.0:1789708668.270544:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:5595:x1876645415767680:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708668.270781:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:5595:x1876645415767680:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 Request processed in 238us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708668.270793:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 237 00000100:00100000:2.0:1789708668.272716:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708668.272982:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415767808 00000100:00100000:3.0:1789708668.272991:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415767808 00000100:00100000:3.0:1789708668.273032:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 238 00000100:00100000:3.0:1789708668.273041:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:9949:x1876645415767808:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789708668.273318:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:9949:x1876645415767808:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 277us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708668.273327:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 238 00000100:00100000:3.0:1789708668.277403:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708668.277514:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415767936 00000100:00100000:1.0:1789708668.277535:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415767936 00000100:00100000:1.0:1789708668.277593:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 239 00000100:00100000:1.0:1789708668.277605:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:9949:x1876645415767936:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789708668.278033:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:9949:x1876645415767936:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 429us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708668.278044:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 239 10000000:01000000:0.0:1789708668.730770:0:5816:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789708668.730777:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1302f7e800 from 7 10000000:01000000:0.0:1789708668.730782:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789708668.730830:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14014a9400/0xa8f741d1c6866335 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708668.730842:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a14014a9400/0xa8f741d1c6866335 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708668.730854:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a14014a9400/0xa8f741d1c6866335 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708668.730879:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426277632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708668.730956:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708668.731014:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405102d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708668.731157:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426277632 00000100:00100000:3.0:1789708668.731165:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426277632 00000100:00100000:3.0:1789708668.731217:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789708668.731226:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:5816:x1876645426277632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708668.731239:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708668.731252:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa38400/0xa8f741d1c686633c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6866335 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708668.731318:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa38400/0xa8f741d1c686633c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6866335 expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708668.731328:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa38400/0xa8f741d1c686633c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6866335 expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708668.731337:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38400, rc 0) 00000100:00100000:3.0:1789708668.731386:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426277632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708668.731393:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789708668.731584:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426277632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708668.731598:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a14014a9400/0xa8f741d1c6866335 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686633c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708668.731607:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a14014a9400/0xa8f741d1c6866335 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c686633c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708668.731678:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426277760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708668.731704:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708668.731733:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405102d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708668.731782:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426277760 00000100:00100000:1.0:1789708668.731787:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426277760 00000100:00100000:1.0:1789708668.731818:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789708668.731825:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426277760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708668.732081:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426277760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708668.732089:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789708668.732391:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426277760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708668.732440:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426277888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708668.732481:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708668.732502:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405102d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708668.732552:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426277888 00000100:00100000:1.0:1789708668.732557:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426277888 00000100:00100000:1.0:1789708668.732590:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789708668.732597:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426277888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708668.732826:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426277888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708668.732834:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789708668.733235:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426277888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708668.738127:0:11653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fac9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:11653:1876645426278016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708668.738220:0:11653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708668.738270:0:11653:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402e6b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789708668.738351:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426278016 00000100:00100000:3.0:1789708668.738359:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426278016 00000100:00100000:3.0:1789708668.738411:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789708668.738420:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:11653:x1876645426278016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708668.738679:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:11653:x1876645426278016:12345-0@lo:502:llog_process_th.0 Request processed in 230us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708668.738686:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789708668.740919:0:11653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fac9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:11653:1876645426278016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708668.740978:0:11653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708668.740989:0:11653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708668.740991:0:11653:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789708668.740999:0:11653:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1302f7e800 00000020:00000080:2.0:1789708668.741001:0:11653:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789708668.741100:0:11653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fac9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:11653:1876645426278144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708668.741166:0:11653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708668.741210:0:11653:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402f31840 going to sleep for 11 seconds 00000100:00100000:1.0:1789708668.744638:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426278144 00000100:00100000:1.0:1789708668.744672:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426278144 00000100:00100000:1.0:1789708668.744723:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789708668.744732:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:11653:x1876645426278144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708668.745010:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:11653:x1876645426278144:12345-0@lo:502:llog_process_th.0 Request processed in 277us (3842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708668.745028:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789708668.745687:0:11653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fac9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:11653:1876645426278144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708668.745726:0:11653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708668.745734:0:11653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708668.745742:0:11653:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789708668.745747:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789708668.746094:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789708668.746123:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789708668.746133:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14014a9400/0xa8f741d1c6866335 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686633c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708668.746141:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a14014a9400/0xa8f741d1c6866335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686633c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708668.746149:0:5816:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789708668.746151:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a143fa6b000 from 7 10000000:01000000:1.0:1789708668.746153:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789708668.746180:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143efc5c00/0xa8f741d1c6866343 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708668.746185:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143efc5c00/0xa8f741d1c6866343 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708668.746192:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143efc5c00/0xa8f741d1c6866343 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708668.746206:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fa05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426278272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789708668.746246:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708668.746298:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f9056c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708668.746355:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426278272 00000100:00100000:3.0:1789708668.746362:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426278272 00000100:00100000:3.0:1789708668.746405:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789708668.746414:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:5816:x1876645426278272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708668.746427:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708668.746440:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c686634a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6866343 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708668.746461:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c686634a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6866343 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708668.746479:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c686634a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6866343 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708668.746487:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38e00, rc 0) 00000100:00100000:3.0:1789708668.746531:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426278272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708668.746537:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789708668.747053:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fa05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426278272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708668.747069:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143efc5c00/0xa8f741d1c6866343 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686634a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708668.747079:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143efc5c00/0xa8f741d1c6866343 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c686634a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708668.747135:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fac9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426278400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708668.747165:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708668.747199:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402f31840 going to sleep for 11 seconds 00000100:00100000:3.0:1789708668.747251:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426278400 00000100:00100000:3.0:1789708668.747256:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426278400 00000100:00100000:3.0:1789708668.747298:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789708668.747306:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426278400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708668.747551:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426278400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708668.747558:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789708668.747679:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fac9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426278400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708668.747715:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fac9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426278528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708668.747752:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708668.747819:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402f31840 going to sleep for 11 seconds 00000100:00100000:1.0:1789708668.753970:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426278528 00000100:00100000:1.0:1789708668.753993:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426278528 00000100:00100000:1.0:1789708668.754061:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789708668.754072:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426278528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708668.754347:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426278528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 276us (6593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708668.754363:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789708668.755799:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fac9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426278528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708668.760257:0:11656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fac8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:11656:1876645426278656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708668.760348:0:11656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708668.765059:0:11656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402f31180 going to sleep for 11 seconds 00000100:00100000:1.0:1789708668.766217:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426278656 00000100:00100000:1.0:1789708668.766244:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426278656 00000100:00100000:1.0:1789708668.766320:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789708668.766332:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:11656:x1876645426278656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708668.766628:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:11656:x1876645426278656:12345-0@lo:502:llog_process_th.0 Request processed in 298us (6279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708668.766636:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789708668.767307:0:11656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fac8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:11656:1876645426278656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708668.767342:0:11656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708668.767352:0:11656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708668.767355:0:11656:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789708668.767362:0:11656:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a143fa6b000 00000020:00000080:2.0:1789708668.767365:0:11656:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789708668.767462:0:11656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fac8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:11656:1876645426278784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708668.767526:0:11656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708668.767558:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426278784 00000100:00100000:2.0:1789708668.767563:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426278784 00000100:00100000:2.0:1789708668.767594:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789708668.767602:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:11656:x1876645426278784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708668.767766:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:11656:x1876645426278784:12345-0@lo:502:llog_process_th.0 Request processed in 164us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708668.767773:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789708668.767806:0:11656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402f31180 going to sleep for 11 seconds 00000100:00100000:2.0:1789708668.767818:0:11656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fac8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:11656:1876645426278784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708668.767836:0:11656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789708668.767840:0:11656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708668.767841:0:11656:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789708668.767845:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789708668.770970:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789708668.771014:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789708668.771026:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143efc5c00/0xa8f741d1c6866343 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686634a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708668.771040:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143efc5c00/0xa8f741d1c6866343 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686634a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708668.771051:0:5816:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789708668.771054:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1410604800 from 7 10000000:01000000:1.0:1789708668.771057:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789708668.771092:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143efc4e00/0xa8f741d1c6866351 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708668.771101:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143efc4e00/0xa8f741d1c6866351 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708668.771111:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143efc4e00/0xa8f741d1c6866351 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708668.771139:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fa04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426278912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789708668.771224:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708668.771264:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f905300 going to sleep for 11 seconds 00000100:00100000:2.0:1789708668.771308:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426278912 00000100:00100000:2.0:1789708668.771316:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426278912 00000100:00100000:2.0:1789708668.771371:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789708668.771382:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:5816:x1876645426278912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708668.771395:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708668.771409:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1403b6a600/0xa8f741d1c6866358 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6866351 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708668.771432:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1403b6a600/0xa8f741d1c6866358 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6866351 expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708668.771443:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1403b6a600/0xa8f741d1c6866358 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6866351 expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708668.771464:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6a600, rc 0) 00000100:00100000:2.0:1789708668.771517:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426278912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708668.771524:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000040:00080000:1.0:1789708668.771960:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789708668.772173:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fa04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426278912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708668.772194:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143efc4e00/0xa8f741d1c6866351 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866358 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708668.772203:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143efc4e00/0xa8f741d1c6866351 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6866358 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708668.772256:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426279040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708668.772295:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708668.772321:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405102480 going to sleep for 11 seconds 00000100:00100000:3.0:1789708668.773834:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426279040 00000100:00100000:3.0:1789708668.773843:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426279040 00000100:00100000:3.0:1789708668.773888:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789708668.773896:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426279040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708668.774170:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426279040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708668.774178:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789708668.774401:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426279040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708668.774457:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426279168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708668.774618:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708668.774676:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405102480 going to sleep for 11 seconds 00000100:00100000:3.0:1789708668.774956:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426279168 00000100:00100000:3.0:1789708668.774962:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426279168 00000100:00100000:3.0:1789708668.775019:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789708668.775026:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426279168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708668.775182:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:5816:x1876645426279168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708668.775194:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789708668.775305:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34efb293-a6d4-48d2-a113-9ec9a49feb73:5816:1876645426279168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789708668.782862:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fac8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:11658:1876645426279296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708668.786061:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708668.786125:0:11658:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402f31c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708668.786335:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426279296 00000100:00100000:0.0:1789708668.786343:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426279296 00000100:00100000:0.0:1789708668.786389:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789708668.786396:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:11658:x1876645426279296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708668.786616:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:11658:x1876645426279296:12345-0@lo:502:llog_process_th.0 Request processed in 220us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708668.786628:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789708668.786674:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fac8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:11658:1876645426279296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789708668.786713:0:11658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789708668.786722:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789708668.786724:0:11658:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789708668.786731:0:11658:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1410604800 00000020:00000080:2.0:1789708668.786733:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789708668.786820:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fac8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:11658:1876645426279424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708668.786866:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708668.786900:0:11658:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402f31c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708668.787346:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426279424 00000100:00100000:0.0:1789708668.787351:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426279424 00000100:00100000:0.0:1789708668.787388:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789708668.787396:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:11658:x1876645426279424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708668.787564:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:11658:x1876645426279424:12345-0@lo:502:llog_process_th.0 Request processed in 168us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708668.787572:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789708668.790083:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fac8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34efb293-a6d4-48d2-a113-9ec9a49feb73:11658:1876645426279424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789708668.790134:0:11658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708668.790145:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708668.790147:0:11658:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789708668.790152:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789708668.790361:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789708668.790392:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789708668.790402:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143efc4e00/0xa8f741d1c6866351 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866358 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708668.790415:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143efc4e00/0xa8f741d1c6866351 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866358 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708669.051070:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789708669.757472:0:7627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c9d2a103-cf70-4470-bdd0-387470668318 00000020:00000080:0.0:1789708669.757481:0:7627:0:(genops.c:885:class_export_put()) final put ffff8a14345eb800/c9d2a103-cf70-4470-bdd0-387470668318 00000020:00000080:0.0:1789708669.757509:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a14345eb800/c9d2a103-cf70-4470-bdd0-387470668318 for lustre-OST0001 00000020:00000080:0.0:1789708669.757556:0:485:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a14345ee800 for lustre-OST0001 00000001:00080000:0.0:1789708669.779282:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:0.0:1789708669.779295:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:0.0:1789708669.779321:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1789708669.779338:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1789708669.779475:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426279552:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789708669.779535:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708669.779612:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426279552 00000100:00100000:0.0:1789708669.779631:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426279552 00000100:00100000:0.0:1789708669.779718:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789708669.779729:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426279552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789708669.779765:0:6672:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1789708669.779799:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aacc978, atime: 0x6aacc978, ctime: 0x6aacc978, blocks: 0x1 00010000:00010000:0.0:1789708669.779808:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a827af5d/0xa8f741d1c686635f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708669.779822:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=235s v=(0 0) 00010000:00010000:0.0:1789708669.779827:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708669.779832:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a827af5d/0xa8f741d1c686635f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708669.779847:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a827af5d/0xa8f741d1c686635f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708669.779857:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a827af5d/0xa8f741d1c686635f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708669.779865:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a827af5d/0xa8f741d1c686635f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708669.779882:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789708669.780394:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3287:x1876645426279552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 666us (857us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789708669.780402:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789708669.780426:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789708669.780444:0:8434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708669.780450:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a827af5d/0xa8f741d1c686635f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708669.780459:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a8e00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708669.780464:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a827af5d/0xa8f741d1c686635f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708669.780474:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a827af5d/0xa8f741d1c686635f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708669.780491:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a827af5d/0xa8f741d1c686635f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708669.780498:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a827af5d/0xa8f741d1c686635f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708669.780518:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708669.780520:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708669.780521:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789708669.780552:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a143fb2a680/2, rc 0, transno 4294967300 00000100:00100000:0.0:1789708669.780559:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426279552:0@lo:6:osp-syn-1-0.0 00000040:00080000:1.0:1789708669.819374:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789708670.074825:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708670.202812:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708670.202858:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708670.202966:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415768320 00000100:00100000:1.0:1789708670.202978:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415768320 00000100:00100000:1.0:1789708670.203068:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:1.0:1789708670.203081:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143faca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2364:x1876645415768320:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708670.203183:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143faca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2364:x1876645415768320:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 104us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708670.203196:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00080000:2.0:1789708670.203340:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708670.204142:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708670.204172:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708670.204227:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415768192 00000100:00100000:1.0:1789708670.204231:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415768192 00000100:00100000:1.0:1789708670.204277:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415768448 00000100:00100000:1.0:1789708670.204281:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415768448 00000100:00100000:1.0:1789708670.204302:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:1.0:1789708670.204307:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143facad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2364:x1876645415768192:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708670.204365:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143facad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2364:x1876645415768192:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 56us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708670.204372:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:1.0:1789708670.204383:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:1.0:1789708670.204387:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143facb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c9d2a103-cf70-4470-bdd0-387470668318+5:2364:x1876645415768448:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708670.204406:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143facb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c9d2a103-cf70-4470-bdd0-387470668318+5:2364:x1876645415768448:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 19us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708670.204410:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00080000:2.0:1789708670.204667:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708670.205101:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415768064 00000100:00100000:0.0:1789708670.205116:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415768064 00000100:00100000:0.0:1789708670.205193:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 255 00000100:00100000:0.0:1789708670.205205:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140309fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2364:x1876645415768064:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708670.205297:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140309fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2364:x1876645415768064:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 95us (2497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708670.205319:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 255 00010000:00010000:0.0:1789708671.099419:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708671.227091:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789708671.227117:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426279680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708671.227186:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708671.227363:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426279680 00000100:00100000:1.0:1789708671.227380:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426279680 00000100:00100000:1.0:1789708671.227434:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789708671.227441:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426279680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789708671.227470:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708671.227505:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426279680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708671.227509:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789708671.227557:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143f511f80 x1876645426279680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708687 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708671.227575:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426279680:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789708671.227707:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708671.742204:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426279936:0@lo:400:kworker.0 00000100:00100000:0.0:1789708671.742284:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708671.742334:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426280448:0@lo:400:kworker.0 00000100:00100000:0.0:1789708671.742358:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708671.742383:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789708671.742389:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426280064:0@lo:400:kworker.0 00000100:00100000:0.0:1789708671.742410:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708671.742530:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fa06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426279808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708671.742561:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708671.742581:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f273100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426280320:0@lo:400:kworker.0 00000100:00100000:1.0:1789708671.742598:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708671.742614:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789708671.742619:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876645426280192:0@lo:400:kworker.0 00000100:00100000:1.0:1789708671.742635:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708671.742680:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426280064 00000100:00100000:1.0:1789708671.742688:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426280064 00000100:00100000:1.0:1789708671.742736:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426280320 00000100:00100000:1.0:1789708671.742740:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426280320 00000100:00100000:1.0:1789708671.744179:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426280192 00000100:00100000:1.0:1789708671.744188:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426280192 00000100:00100000:1.0:1789708671.744213:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789708671.744222:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426280064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708671.744305:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426280064:12345-0@lo:400:kworker.0 Request processed in 84us (1893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708671.744325:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789708671.744344:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789708671.744350:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426280320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708671.744385:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426280320:12345-0@lo:400:kworker.0 Request processed in 36us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708671.744391:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789708671.744402:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789708671.744408:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876645426280192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708671.744433:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876645426280192:12345-0@lo:400:kworker.0 Request processed in 26us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708671.744439:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1789708671.744466:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708671.744477:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426279808 00000100:00100000:1.0:1789708671.744481:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426279808 00000100:00100000:1.0:1789708671.744511:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789708671.744516:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1876645426279808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789708671.744542:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708671.744572:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1876645426279808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (2011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708671.744578:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1789708671.744596:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708671.744637:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876645426280192:0@lo:400:kworker.0 00000100:00100000:1.0:1789708671.744675:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fa06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426279808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708671.744686:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f273100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426280320:0@lo:400:kworker.0 00000100:00100000:1.0:1789708671.744967:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426280448 00000100:00100000:1.0:1789708671.744972:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426280448 00000100:00100000:1.0:1789708671.744996:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789708671.745002:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1876645426280448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708671.745032:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1876645426280448:12345-0@lo:400:kworker.0 Request processed in 30us (2673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708671.745037:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789708671.745146:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426280064:0@lo:400:kworker.0 00000100:00100000:0.0:1789708671.745157:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426280448:0@lo:400:kworker.0 00000100:00100000:2.0:1789708671.745241:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426279936 00000100:00100000:2.0:1789708671.745246:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426279936 00000100:00100000:2.0:1789708671.745298:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789708671.745305:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3286:x1876645426279936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708671.745342:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3286:x1876645426279936:12345-0@lo:400:kworker.0 Request processed in 38us (3058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708671.745347:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789708671.745573:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426279936:0@lo:400:kworker.0 00010000:00010000:2.0:1789708672.122903:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708673.147899:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708674.172434:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789708674.906624:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1789708675.194889:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708675.320604:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708675.320645:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708675.320818:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708675.320900:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415768576 00000100:00100000:0.0:1789708675.320909:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415768576 00000100:00100000:0.0:1789708675.320966:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 257 00000100:00100000:0.0:1789708675.320975:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2361:x1876645415768576:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708675.321054:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2361:x1876645415768576:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 80us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708675.321076:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 257 00000100:00100000:3.0:1789708675.321480:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415768704 00000100:00100000:3.0:1789708675.321486:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415768704 00000100:00100000:3.0:1789708675.321578:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415768960 00000100:00100000:3.0:1789708675.321582:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415768960 00000100:00100000:3.0:1789708675.321610:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 65 00000100:00100000:3.0:1789708675.321617:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2361:x1876645415768704:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708675.321684:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2361:x1876645415768704:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 67us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708675.321692:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 65 00000100:00100000:3.0:1789708675.321706:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00100000:3.0:1789708675.321712:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c9d2a103-cf70-4470-bdd0-387470668318+5:2361:x1876645415768960:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708675.321736:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c9d2a103-cf70-4470-bdd0-387470668318+5:2361:x1876645415768960:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708675.321873:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00080000:0.0:1789708675.321991:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708675.323069:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708675.323771:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415768832 00000100:00100000:0.0:1789708675.323780:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415768832 00000100:00100000:0.0:1789708675.323849:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:0.0:1789708675.323858:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2361:x1876645415768832:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708675.323919:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2361:x1876645415768832:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 62us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708675.323927:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00080000:1.0:1789708675.324373:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789708676.225847:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708676.350087:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426280576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708676.350173:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708676.350446:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426280576 00000100:00100000:2.0:1789708676.350455:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426280576 00000100:00100000:2.0:1789708676.350523:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789708676.350534:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426280576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789708676.350572:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789708676.350618:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426280576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708676.350625:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789708676.352277:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789708676.352327:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143f512d80 x1876645426280576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708676.352351:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426280576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708676.859008:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789708676.860142:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143efa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426280832:0@lo:400:kworker.0 00000100:00100000:3.0:1789708676.860243:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708676.860410:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143ec30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426280704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789708676.860445:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708676.860606:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426280704 00000100:00100000:2.0:1789708676.860624:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426280704 00000100:00100000:2.0:1789708676.860750:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789708676.860761:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426280704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789708676.860810:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789708676.860855:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426280704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708676.860862:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789708676.860996:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789708676.861021:0:3289:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1789708676.861027:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a143fb2a680, transno 4294967300 00000100:00100000:3.0:1789708676.861054:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143ec30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426280704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708676.862019:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143efa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426280960:0@lo:400:kworker.0 00000100:00100000:1.0:1789708676.862060:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708676.862100:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708676.862106:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143efa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426281088:0@lo:400:kworker.0 00000100:00100000:1.0:1789708676.862127:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708676.862154:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426280960 00000100:00100000:1.0:1789708676.862160:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426280960 00000100:00100000:1.0:1789708676.862190:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426281088 00000100:00100000:1.0:1789708676.862193:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426281088 00000100:00100000:1.0:1789708676.862234:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789708676.862242:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426280960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708676.862422:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426280960:12345-0@lo:400:kworker.0 Request processed in 180us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708676.862429:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789708676.862446:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789708676.862453:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426281088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708676.862480:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426281088:12345-0@lo:400:kworker.0 Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708676.862485:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789708676.862701:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143efa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426281088:0@lo:400:kworker.0 00000100:00100000:1.0:1789708676.862714:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143efa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426280960:0@lo:400:kworker.0 00000100:00080000:3.0:1789708676.863211:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708676.863225:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789708676.863237:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143efa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426281216:0@lo:400:kworker.0 00000100:00100000:3.0:1789708676.863335:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708676.863471:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426281216 00000100:00100000:1.0:1789708676.863476:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426281216 00000100:00080000:3.0:1789708676.863632:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708676.863798:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789708676.863807:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426281216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708676.863859:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426281216:12345-0@lo:400:kworker.0 Request processed in 54us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708676.863866:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789708676.863927:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143efa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426281216:0@lo:400:kworker.0 00000100:00100000:0.0:1789708676.864437:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426280832 00000100:00100000:0.0:1789708676.864443:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426280832 00000100:00100000:0.0:1789708676.864474:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789708676.864481:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426280832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708676.864976:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426280832:12345-0@lo:400:kworker.0 Request processed in 495us (4732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708676.864984:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789708676.865066:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143efa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426280832:0@lo:400:kworker.0 00010000:00010000:0.0:1789708677.244990:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708678.272553:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789708679.035935:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789708679.290930:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708680.317567:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708680.441243:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708680.441360:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708680.441412:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708680.441457:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708680.441582:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415769216 00000100:00100000:0.0:1789708680.441593:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415769216 00000100:00100000:0.0:1789708680.441681:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415769472 00000100:00100000:0.0:1789708680.441685:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415769472 00000100:00100000:0.0:1789708680.441717:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 70 00000100:00100000:0.0:1789708680.441726:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2364:x1876645415769216:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708680.441869:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2364:x1876645415769216:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 144us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708680.441897:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 70 00000100:00100000:0.0:1789708680.441917:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 71 00000100:00100000:0.0:1789708680.441926:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c9d2a103-cf70-4470-bdd0-387470668318+5:2364:x1876645415769472:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708680.441936:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415769344 00000100:00100000:1.0:1789708680.441943:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415769344 00000100:00100000:0.0:1789708680.441954:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c9d2a103-cf70-4470-bdd0-387470668318+5:2364:x1876645415769472:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 29us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708680.441962:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 71 00000100:00100000:1.0:1789708680.441990:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:1.0:1789708680.441999:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2364:x1876645415769344:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708680.442033:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2364:x1876645415769344:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 36us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708680.442040:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00080000:3.0:1789708680.444847:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789708680.444859:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708680.451893:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415769088 00000100:00100000:2.0:1789708680.451911:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415769088 00000100:00100000:2.0:1789708680.451985:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 259 00000100:00100000:2.0:1789708680.451996:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2364:x1876645415769088:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708680.452085:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2364:x1876645415769088:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 91us (10851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708680.452093:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 259 00010000:00010000:0.0:1789708681.338902:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708681.467108:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426281344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708681.467192:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708681.467339:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426281344 00000100:00100000:2.0:1789708681.467349:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426281344 00000100:00100000:2.0:1789708681.467421:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789708681.467432:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426281344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789708681.467476:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789708681.467531:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426281344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708681.467539:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1789708681.467677:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789708681.467764:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143f510e00 x1876645426281344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708681.467783:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426281344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708681.979243:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789708681.979268:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143efa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426281472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708681.979343:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708681.979570:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426281600:0@lo:400:kworker.0 00000100:00100000:0.0:1789708681.979627:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708681.979687:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789708681.979694:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876645426281984:0@lo:400:kworker.0 00000100:00100000:0.0:1789708681.979721:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708681.979898:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426281600 00000100:00100000:3.0:1789708681.979908:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426281600 00000100:00100000:3.0:1789708681.979971:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789708681.979979:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3287:x1876645426281600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708681.980029:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3287:x1876645426281600:12345-0@lo:400:kworker.0 Request processed in 50us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708681.980037:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789708681.980283:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426281728:0@lo:400:kworker.0 00000100:00100000:2.0:1789708681.980314:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708681.980347:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789708681.980354:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426281856:0@lo:400:kworker.0 00000100:00100000:2.0:1789708681.980376:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708681.980404:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426281984 00000100:00100000:2.0:1789708681.980409:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426281984 00000100:00100000:2.0:1789708681.980447:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426281728 00000100:00100000:2.0:1789708681.980450:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426281728 00000100:00100000:2.0:1789708681.980467:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426281856 00000100:00100000:2.0:1789708681.980469:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426281856 00000100:00100000:2.0:1789708681.980494:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789708681.980500:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876645426281984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708681.980535:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876645426281984:12345-0@lo:400:kworker.0 Request processed in 35us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708681.980541:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789708681.980553:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789708681.980559:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426281728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708681.980604:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426281728:12345-0@lo:400:kworker.0 Request processed in 45us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708681.980609:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789708681.980633:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789708681.980640:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426281856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708681.980862:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426281856:12345-0@lo:400:kworker.0 Request processed in 222us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708681.980869:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1789708681.980893:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708681.980996:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426281856:0@lo:400:kworker.0 00000100:00100000:2.0:1789708681.981011:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426281728:0@lo:400:kworker.0 00000100:00100000:0.0:1789708681.981114:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876645426281984:0@lo:400:kworker.0 00000100:00100000:0.0:1789708681.981125:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426281600:0@lo:400:kworker.0 00000100:00100000:1.0:1789708681.981227:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426281472 00000100:00100000:1.0:1789708681.981233:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426281472 00000100:00100000:1.0:1789708681.981288:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789708681.981296:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426281472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789708681.981327:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708681.981374:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426281472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (2031us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708681.981381:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789708681.981421:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143efa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426281472:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789708681.981569:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789708682.364452:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708683.387065:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708684.410873:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708685.435069:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708685.561016:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708685.561410:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708685.561516:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415769728 00000100:00100000:2.0:1789708685.561526:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415769728 00000100:00100000:2.0:1789708685.561612:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 75 00000100:00100000:2.0:1789708685.561624:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2364:x1876645415769728:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708685.561727:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2364:x1876645415769728:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 105us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708685.561748:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 75 00000100:00080000:3.0:1789708685.562052:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708685.562134:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415769600 00000100:00100000:0.0:1789708685.562139:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415769600 00000100:00100000:0.0:1789708685.562178:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 261 00000100:00100000:0.0:1789708685.562193:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2364:x1876645415769600:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708685.562314:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2364:x1876645415769600:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 121us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708685.562321:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 261 00000100:00100000:3.0:1789708685.569305:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708685.569439:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415769856 00000100:00100000:0.0:1789708685.569449:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415769856 00000100:00100000:0.0:1789708685.569566:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:0.0:1789708685.569577:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2360:x1876645415769856:12345-192.168.202.53@tcp:9:kworker.0 00000020:00000080:0.0:1789708685.569614:0:6673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c686629b 00000100:00080000:0.0:1789708685.569624:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8a13069bd800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789708685.569703:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1789708685.569968:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+2:2360:x1876645415769856:12345-192.168.202.53@tcp:9:kworker.0 Request processed in 392us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708685.569975:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00010000:00010000:1.0:1789708685.570166:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789708685.570689:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708685.570862:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708685.570935:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415769984 00000100:00100000:3.0:1789708685.570941:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415769984 00000100:00100000:3.0:1789708685.570988:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 76 00000100:00100000:3.0:1789708685.570996:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c9d2a103-cf70-4470-bdd0-387470668318+5:2364:x1876645415769984:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708685.571044:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c9d2a103-cf70-4470-bdd0-387470668318+5:2364:x1876645415769984:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 50us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708685.571051:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 76 00000100:00080000:2.0:1789708685.571401:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789708686.465247:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708686.586986:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789708686.587009:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426282112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789708686.587073:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708686.587279:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426282112 00000100:00100000:3.0:1789708686.587288:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426282112 00000100:00100000:3.0:1789708686.587350:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789708686.587359:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426282112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789708686.587395:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708686.587451:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426282112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708686.587459:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789708686.587533:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143f510380 x1876645426282112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708686.587551:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426282112:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789708686.587604:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708687.169227:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143efa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426282240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708687.169308:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708687.198574:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426282240 00000100:00100000:0.0:1789708687.198590:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426282240 00000100:00100000:0.0:1789708687.198673:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789708687.198686:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143facb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426282240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789708687.198728:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789708687.198811:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143facb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426282240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (29502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708687.198819:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789708687.198871:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143efa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426282240:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789708687.198904:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708687.199133:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143efa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426282496:0@lo:400:kworker.0 00000100:00100000:1.0:1789708687.199176:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708687.199218:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708687.199224:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143efa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426282624:0@lo:400:kworker.0 00000100:00100000:1.0:1789708687.199248:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708687.199284:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426282496 00000100:00100000:1.0:1789708687.199288:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426282496 00000100:00100000:1.0:1789708687.199316:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426282624 00000100:00100000:1.0:1789708687.199329:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426282624 00000100:00100000:1.0:1789708687.199355:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789708687.199361:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426282496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708687.199398:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426282496:12345-0@lo:400:kworker.0 Request processed in 37us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708687.199405:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789708687.199418:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789708687.199424:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426282624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708687.199451:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426282624:12345-0@lo:400:kworker.0 Request processed in 27us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708687.199457:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789708687.199485:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143efa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426282624:0@lo:400:kworker.0 00000100:00100000:1.0:1789708687.199494:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143efa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426282496:0@lo:400:kworker.0 00000100:00100000:2.0:1789708687.199825:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143efa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426282368:0@lo:400:kworker.0 00000100:00100000:2.0:1789708687.199862:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708687.199892:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789708687.199897:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143efa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426282752:0@lo:400:kworker.0 00000100:00100000:2.0:1789708687.199915:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789708687.199981:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708687.200113:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426282368 00000100:00100000:3.0:1789708687.200118:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426282368 00000100:00100000:3.0:1789708687.200157:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789708687.200165:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426282368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708687.200210:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426282368:12345-0@lo:400:kworker.0 Request processed in 46us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708687.200216:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789708687.200290:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426282752 00000100:00100000:1.0:1789708687.200294:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426282752 00000100:00100000:1.0:1789708687.200336:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789708687.200343:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143facb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426282752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708687.200375:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143facb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426282752:12345-0@lo:400:kworker.0 Request processed in 33us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708687.200381:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789708687.200467:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143efa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426282752:0@lo:400:kworker.0 00000100:00100000:2.0:1789708687.200475:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143efa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426282368:0@lo:400:kworker.0 00000100:00080000:3.0:1789708687.200557:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789708687.483897:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708688.507126:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789708689.277373:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789708689.530800:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789708690.275162:0:7627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14bb7f14-3461-47f6-86c9-db3f545050ad 00000020:00000080:0.0:1789708690.275171:0:7627:0:(genops.c:885:class_export_put()) final put ffff8a140318f800/14bb7f14-3461-47f6-86c9-db3f545050ad 00000020:00000080:2.0:1789708690.275385:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a140318f800/14bb7f14-3461-47f6-86c9-db3f545050ad for lustre-OST0001 00000020:00000080:2.0:1789708690.275436:0:485:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a13069bd800 for lustre-OST0001 00010000:00010000:0.0:1789708690.561825:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708691.041410:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708691.041456:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708691.041491:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708691.041550:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415770368 00000100:00100000:2.0:1789708691.041562:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415770368 00000100:00100000:0.0:1789708691.041672:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415770112 00000100:00100000:0.0:1789708691.041676:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415770112 00000100:00100000:0.0:1789708691.041707:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 263 00000100:00100000:0.0:1789708691.041718:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2363:x1876645415770112:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708691.041800:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2363:x1876645415770112:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 84us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708691.041808:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 263 00000100:00100000:2.0:1789708691.042254:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415770240 00000100:00100000:2.0:1789708691.042274:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415770240 00000100:00080000:3.0:1789708691.044352:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708691.044438:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 80 00000100:00100000:2.0:1789708691.044456:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143facbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c9d2a103-cf70-4470-bdd0-387470668318+5:2363:x1876645415770368:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708691.044550:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143facbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c9d2a103-cf70-4470-bdd0-387470668318+5:2363:x1876645415770368:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 100us (3092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708691.044559:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 80 00000100:00100000:2.0:1789708691.044579:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 81 00000100:00100000:2.0:1789708691.044586:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143faca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2363:x1876645415770240:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708691.044611:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143faca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2363:x1876645415770240:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (3119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708691.044616:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 81 00000001:02000400:2.0:1789708691.453484:0:11822:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:18:10 (1789708690) 00010000:00010000:2.0:1789708691.600197:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708691.716076:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426282880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789708691.716179:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708691.716289:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426282880 00000100:00100000:2.0:1789708691.716300:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426282880 00000100:00100000:2.0:1789708691.716380:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789708691.716392:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426282880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789708691.716442:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789708691.716491:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426282880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708691.716499:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789708691.716547:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143fb28380 x1876645426282880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708691.716778:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426282880:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789708691.718166:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708692.222260:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426283136:0@lo:400:kworker.0 00000100:00100000:1.0:1789708692.222364:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708692.222416:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426283136 00000100:00100000:3.0:1789708692.222427:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426283136 00000100:00100000:3.0:1789708692.222483:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789708692.222492:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3287:x1876645426283136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708692.222818:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3287:x1876645426283136:12345-0@lo:400:kworker.0 Request processed in 326us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708692.222827:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789708692.223168:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426283136:0@lo:400:kworker.0 00000100:00100000:1.0:1789708692.223200:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876645426283648:0@lo:400:kworker.0 00000100:00100000:0.0:1789708692.223596:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143efa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426283008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708692.223686:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876645426283392:0@lo:400:kworker.0 00000100:00100000:0.0:1789708692.247584:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708692.247688:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426283520:0@lo:400:kworker.0 00000100:00100000:0.0:1789708692.247739:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708692.247792:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426283008 00000100:00100000:0.0:1789708692.247799:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426283264:0@lo:400:kworker.0 00000100:00100000:3.0:1789708692.247811:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426283008 00000100:00100000:0.0:1789708692.247851:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708692.247883:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426283776:0@lo:400:kworker.0 00000100:00100000:3.0:1789708692.247914:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789708692.247916:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708692.247940:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426283008:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708692.247978:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426283520 00002000:00000024:3.0:1789708692.247981:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789708692.247998:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426283520 00000100:00100000:0.0:1789708692.248052:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426283776 00000100:00100000:0.0:1789708692.248065:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426283776 00000100:00100000:0.0:1789708692.248087:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789708692.248095:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f270a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426283520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708692.248164:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1876645426283008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 231us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708692.248176:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1789708692.248206:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708692.253081:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708692.253194:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426283264 00000100:00100000:1.0:1789708692.253206:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426283264 00000100:00100000:1.0:1789708692.253272:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426283648 00000100:00100000:1.0:1789708692.253275:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426283648 00000100:00100000:3.0:1789708692.253324:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789708692.253347:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426283264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708692.253386:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f270a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426283520:12345-0@lo:400:kworker.0 Request processed in 5287us (5642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708692.253417:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789708692.253458:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426283264:12345-0@lo:400:kworker.0 Request processed in 120us (5606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708692.253506:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789708692.253518:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876645426283648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708692.253589:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789708692.253708:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876645426283648:12345-0@lo:400:kworker.0 Request processed in 191us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708692.253744:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1789708692.253769:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708692.253809:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f270700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426283776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708692.253909:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876645426283648:0@lo:400:kworker.0 00000100:00100000:2.0:1789708692.253994:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f270700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426283776:12345-0@lo:400:kworker.0 Request processed in 397us (6086us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708692.254001:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789708692.254025:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708692.254048:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426283392 00000100:00100000:2.0:1789708692.254052:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426283392 00000100:00100000:2.0:1789708692.254360:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789708692.254366:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876645426283392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708692.254398:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876645426283392:12345-0@lo:400:kworker.0 Request processed in 32us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708692.254404:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1789708692.254418:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708692.254445:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876645426283392:0@lo:400:kworker.0 00000100:00100000:2.0:1789708692.254487:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426283264:0@lo:400:kworker.0 00000100:00100000:2.0:1789708692.254498:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426283776:0@lo:400:kworker.0 00000100:00100000:2.0:1789708692.254544:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143efa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426283008:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789708692.254558:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143f510a80 x1876645426283520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789708708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708692.254585:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426283520:0@lo:400:kworker.0 00000100:00100000:3.0:1789708692.260434:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:0.0:1789708692.602977:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708693.626920:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708694.016712:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708694.016848:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415770496 00000100:00100000:1.0:1789708694.016858:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415770496 00000100:00100000:1.0:1789708694.016941:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:1.0:1789708694.016953:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:10219:x1876645415770496:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708694.016974:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708694.016997:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866366 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d481d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708694.017070:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5e00/0xa8f741d1c686636d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708694.017083:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5e00/0xa8f741d1c686636d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708694.017094:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5e00/0xa8f741d1c686636d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708694.017146:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789708694.017150:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789708694.017182:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5e00/0xa8f741d1c686636d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708694.017206:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866366 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d481d expref: 7 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708694.017223:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5e00/0xa8f741d1c686636d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d481d expref: 6 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708694.017232:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:1.0:1789708694.017235:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708694.017238:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5e00, rc 0) 00000100:00100000:1.0:1789708694.017292:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+6:10219:x1876645415770496:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 341us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708694.017301:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00080000:2.0:1789708694.017752:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708694.031463:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708694.032570:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415770624 00000100:00100000:2.0:1789708694.032583:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415770624 00000100:00100000:2.0:1789708694.032695:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:2.0:1789708694.032706:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:10220:x1876645415770624:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708694.032726:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708694.032745:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866374 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4824 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.032808:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686637b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.032824:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686637b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.032836:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686637b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.032851:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866382 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.032859:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866382 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.032865:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866382 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033339:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ae00/0xa8f741d1c6866389 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033349:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ae00/0xa8f741d1c6866389 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033357:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ae00/0xa8f741d1c6866389 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708694.033384:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789708694.033388:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789708694.033409:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ae00/0xa8f741d1c6866389 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033420:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686637b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033428:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686637b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033434:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686637b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033440:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708694.033445:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686637b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033453:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686637b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033464:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:2.0:1789708694.033473:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708694.033479:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686637b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033485:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686637b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033511:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866382 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033518:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866382 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033524:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866382 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033530:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6bc00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708694.033532:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866382 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033538:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866382 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033546:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a1414c38000) 00010000:00010000:2.0:1789708694.033549:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708694.033551:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866382 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033557:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866382 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033590:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866374 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4824 expref: 8 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033750:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ae00/0xa8f741d1c6866389 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4824 expref: 7 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708694.033757:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1414c38a00) 00010000:00010000:2.0:1789708694.033760:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708694.033762:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6ae00, rc 0) 00000100:00100000:2.0:1789708694.033832:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+7:10220:x1876645415770624:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 1128us (2380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708694.033840:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:0.0:1789708694.041493:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708694.041573:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415770880 00000100:00100000:3.0:1789708694.041586:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415770880 00000100:00100000:3.0:1789708694.041699:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:3.0:1789708694.041710:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+7:10220:x1876645415770880:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708694.041753:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708694.041776:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866390 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d482b expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.041874:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866397 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.041892:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866397 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.041905:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866397 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.043596:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c686639e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.043620:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c686639e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.043633:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c686639e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.044189:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38000/0xa8f741d1c68663a5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.044201:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38000/0xa8f741d1c68663a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.044220:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38000/0xa8f741d1c68663a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708694.044233:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789708694.044392:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866397 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.044401:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866397 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.044408:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866397 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.044414:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708694.044419:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866397 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.044428:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866397 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.044442:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1414c38a00) 00010000:00010000:3.0:1789708694.044445:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708694.044450:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866397 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.044457:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866397 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.044471:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c686639e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.044477:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c686639e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.044483:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c686639e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.044498:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708694.044502:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c686639e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.044508:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c686639e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.044516:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a1411b4a000) 00010000:00010000:3.0:1789708694.044519:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708694.044521:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c686639e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.044527:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c686639e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.045500:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866390 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d482b expref: 10 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.045949:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38000/0xa8f741d1c68663a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d482b expref: 9 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708694.045959:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1411b4a700) 00010000:00010000:3.0:1789708694.045963:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708694.045968:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38000, rc 0) 00000100:00100000:3.0:1789708694.046287:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+9:10220:x1876645415770880:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 4576us (4805us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789708694.046297:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:3.0:1789708694.064973:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708694.065247:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415771008 00000100:00100000:2.0:1789708694.065261:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415771008 00000100:00100000:2.0:1789708694.065385:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:2.0:1789708694.065397:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+9:10220:x1876645415771008:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789708694.065537:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+9:10220:x1876645415771008:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 Request processed in 143us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708694.065546:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 34 00000040:00080000:2.0:1789708694.395422:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789708694.659601:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789708695.317560:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:2.0:1789708695.676074:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708695.884003:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708695.884056:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708695.884088:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708695.884116:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415771392 00000100:00100000:1.0:1789708695.884126:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415771392 00000100:00100000:0.0:1789708695.884138:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415771264 00000100:00100000:0.0:1789708695.884145:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415771264 00000100:00100000:3.0:1789708695.884232:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415771136 00000100:00100000:3.0:1789708695.884236:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415771136 00000100:00100000:3.0:1789708695.884264:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 265 00000100:00100000:3.0:1789708695.884271:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2364:x1876645415771136:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708695.884336:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2364:x1876645415771136:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 64us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708695.884343:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 265 00000100:00100000:1.0:1789708695.884399:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 85 00000100:00100000:1.0:1789708695.884406:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2364:x1876645415771264:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708695.884439:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2364:x1876645415771264:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 33us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708695.884457:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 85 00000100:00100000:1.0:1789708695.884471:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 86 00000100:00100000:1.0:1789708695.884477:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c9d2a103-cf70-4470-bdd0-387470668318+5:2364:x1876645415771392:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708695.884503:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c9d2a103-cf70-4470-bdd0-387470668318+5:2364:x1876645415771392:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708695.884509:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 86 00000100:00080000:1.0:1789708695.884613:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789708696.702340:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708696.793144:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708696.793725:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415771520 00000100:00100000:2.0:1789708696.793737:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415771520 00000100:00100000:2.0:1789708696.793809:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00100000:2.0:1789708696.793820:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+8:10262:x1876645415771520:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708696.793842:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708696.793864:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68663b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4832 expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.793942:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.793956:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.793967:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.793980:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c68663c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.793987:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c68663c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.793994:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c68663c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.794191:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.794199:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.794205:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.794211:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708696.794215:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.794245:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.794259:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:2.0:1789708696.794262:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708696.794267:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.794273:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.794285:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c68663c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.794291:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c68663c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.794297:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c68663c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.794302:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708696.794305:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c68663c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.794311:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c68663c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.794317:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a1414c38000) 00010000:00010000:2.0:1789708696.794320:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708696.794322:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c68663c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.794338:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c68663c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.794372:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68663b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4832 expref: 9 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.794381:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:2.0:1789708696.794383:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708696.794387:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68663b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4832 expref: 9 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.794396:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6be00, rc 0) 00000100:00100000:2.0:1789708696.794457:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+8:10262:x1876645415771520:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 639us (1324us total) trans 0 rc 301/301 00000100:00100000:2.0:1789708696.794465:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00080000:1.0:1789708696.794783:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708696.807136:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708696.807214:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415771776 00000100:00100000:0.0:1789708696.807238:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415771776 00000100:00100000:0.0:1789708696.807305:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:0.0:1789708696.807316:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+8:10262:x1876645415771776:12345-192.168.202.53@tcp:36:lfs.0 00010000:00010000:0.0:1789708696.807370:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708696.807396:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5e00/0xa8f741d1c686636d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d481d expref: 8 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.807415:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:0.0:1789708696.807426:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708696.807634:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c68663c8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.807672:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c68663c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.807684:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c68663c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.807698:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68663cf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.807716:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68663cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.807724:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68663cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708696.812533:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789708696.812556:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c68663c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.812568:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c68663c8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.812576:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c68663c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.812582:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a8e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708696.812587:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c68663c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.812596:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c68663c8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.812613:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14148f3100) 00010000:00010000:0.0:1789708696.812617:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708696.812621:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c68663c8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.812628:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c68663c8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708696.813615:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae71fd68 reply state 00000000f173294a transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68663cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708696.813629:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789708696.814162:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+9:10262:x1876645415771776:12345-192.168.202.53@tcp:36:lfs.0 Request processed in 6842us (7030us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789708696.814172:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 36 00010000:00010000:0.0:1789708696.821042:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68663cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.821062:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68663cf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.821072:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68663cf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.821079:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a8800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708696.821084:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68663cf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.821093:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68663cf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.821111:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a14148f3900) 00010000:00010000:0.0:1789708696.821115:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708696.821120:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68663cf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708696.821126:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68663cf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708696.832187:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789708696.832215:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426283904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708696.832310:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708696.832392:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426283904 00000100:00100000:3.0:1789708696.832401:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426283904 00000100:00100000:3.0:1789708696.832461:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789708696.832472:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426283904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789708696.832508:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708696.832553:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426283904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708696.832560:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1789708696.832603:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a143f513480 x1876645426283904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708696.832622:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426283904:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789708696.832811:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708696.939729:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708696.939809:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415771904 00000100:00100000:2.0:1789708696.939818:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415771904 00000100:00100000:2.0:1789708696.939883:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:2.0:1789708696.939893:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+8:10271:x1876645415771904:12345-192.168.202.53@tcp:101:lctl.0 00010000:00010000:2.0:1789708696.939917:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708696.939939:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68663d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4839 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.939999:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c68663dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.940024:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c68663dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.940046:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c68663dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708696.940079:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789708696.940083:0:11601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789708696.940131:0:11601:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c68663dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.940154:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68663d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4839 expref: 10 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.940171:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c68663dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4839 expref: 9 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708696.940179:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38000) 00010000:00010000:2.0:1789708696.940182:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708696.940185:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6b000, rc 0) 00000100:00100000:2.0:1789708696.940233:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+9:10271:x1876645415771904:12345-192.168.202.53@tcp:101:lctl.0 Request processed in 342us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708696.940240:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:3.0:1789708697.010698:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708697.010882:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415772032 00000100:00100000:2.0:1789708697.010893:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415772032 00000100:00100000:2.0:1789708697.010952:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 38 00000100:00100000:2.0:1789708697.010962:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+9:10277:x1876645415772032:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1789708697.010981:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708697.011001:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68663e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4840 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011101:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011115:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011127:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011139:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68663f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011146:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68663f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011152:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68663f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011232:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68663f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011239:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68663f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011255:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68663f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708697.011279:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789708697.011282:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789708697.011315:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68663f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011336:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011342:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011350:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011356:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708697.011360:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011367:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011378:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38000) 00010000:00010000:2.0:1789708697.011381:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708697.011385:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011390:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68663eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011402:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68663f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011409:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68663f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011416:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68663f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011426:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6aa00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708697.011429:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68663f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011434:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68663f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011442:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a1414c38500) 00010000:00010000:2.0:1789708697.011444:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708697.011447:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68663f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011453:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68663f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011597:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68663e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4840 expref: 11 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011612:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68663f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4840 expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.011619:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:2.0:1789708697.011621:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789708697.011623:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6b200, rc 0) 00000100:00100000:2.0:1789708697.011828:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+10:10277:x1876645415772032:12345-192.168.202.53@tcp:101:bash.0 Request processed in 867us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708697.011836:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 38 00000100:00100000:3.0:1789708697.015252:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708697.015344:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415772288 00000100:00100000:0.0:1789708697.015355:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415772288 00000100:00100000:0.0:1789708697.015423:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:0.0:1789708697.015434:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+10:10277:x1876645415772288:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1789708697.015454:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708697.015473:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c6866400 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4847 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.015613:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866407 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.015627:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866407 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.015637:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866407 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.015750:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c686640e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.015759:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c686640e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.015766:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c686640e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789708697.016306:0:5819:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789708697.016458:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c6866415 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.016477:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c6866415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.016485:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c6866415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.016517:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866407 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.016524:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866407 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.016531:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866407 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.016536:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a9200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708697.016540:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866407 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.016548:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866407 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.016558:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:0.0:1789708697.016561:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708697.016566:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866407 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.016573:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866407 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708697.016586:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bedd6fc2 reply state 00000000b76b3b34 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c686640e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708697.016600:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789708697.016629:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c6866400 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4847 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.016642:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c6866415 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4847 expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.016675:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14148f3100) 00010000:00010000:0.0:1789708697.016677:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708697.016680:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14014a8800, rc 0) 00000100:00100000:0.0:1789708697.016738:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+13:10277:x1876645415772288:12345-192.168.202.53@tcp:101:bash.0 Request processed in 1307us (1505us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789708697.016746:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 39 00010000:00010000:1.0:1789708697.024142:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c686640e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.024159:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c686640e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.024167:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c686640e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.024172:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a8400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708697.024176:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c686640e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.024184:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c686640e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.024199:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a14148f3900) 00010000:00010000:1.0:1789708697.024201:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708697.024217:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c686640e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.024224:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c686640e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708697.029838:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708697.029939:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415772416 00000100:00100000:1.0:1789708697.029948:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415772416 00000100:00100000:1.0:1789708697.029995:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:1.0:1789708697.030002:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1876645415772416:12345-192.168.202.53@tcp:8:bash.0 00010000:00080000:1.0:1789708697.030041:0:6673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:1.0:1789708697.030068:0:6673:0:(genops.c:1384:class_connect()) connect: client 14bb7f14-3461-47f6-86c9-db3f545050ad, cookie 0xa8f741d1c6866423 00002000:00100000:1.0:1789708697.030080:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 14bb7f14-3461-47f6-86c9-db3f545050ad/ffff8a1434bf9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789708697.030090:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789708697.030353:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789708697.030384:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8a1434bfe800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708697.030596:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2360:x1876645415772416:12345-192.168.202.53@tcp:8:bash.0 Request processed in 591us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708697.030605:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:0.0:1789708697.047153:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708697.047259:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415772544 00000100:00100000:2.0:1789708697.047282:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415772544 00000100:00100000:2.0:1789708697.047364:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:2.0:1789708697.047375:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+6:0:x1876645415772544:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1789708697.047392:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708697.047416:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686642a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d484e expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789708697.047442:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789708697.047461:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=262s v=(0 0) 00010000:00010000:2.0:1789708697.047465:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708697.047485:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686642a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d484e expref: 7 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.047505:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686642a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d484e expref: 7 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.047518:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6be00, rc 0) 00000100:00100000:2.0:1789708697.047575:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+7:0:x1876645415772544:12345-192.168.202.53@tcp:101:bash.0 Request processed in 203us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708697.047581:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00080000:1.0:1789708697.048121:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708697.051037:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708697.051464:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415772672 00000100:00100000:2.0:1789708697.051474:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415772672 00000100:00100000:2.0:1789708697.051624:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:2.0:1789708697.051634:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+7:10277:x1876645415772672:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1789708697.051686:0:10424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708697.051703:0:10424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c6866431 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4855 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.051747:0:10424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686642a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d484e expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.051756:0:10424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708697.051760:0:10424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708697.051765:0:10424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c6866431 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4855 expref: 8 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.051802:0:10424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686642a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d484e expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.051816:0:10424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686642a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d484e expref: 8 pid: 6670 timeout: 362 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708697.051829:0:10424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb29f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10424:1876645426284032:192.168.202.53@tcp:104: 00000100:00100000:2.0:1789708697.051917:0:10424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1410bda480 going to sleep for 11 seconds 00000100:00100000:3.0:1789708697.059427:0:10424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb29f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10424:1876645426284032:192.168.202.53@tcp:104: 00010000:00010000:3.0:1789708697.059464:0:10424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c6866431 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4855 expref: 8 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708697.059485:0:10424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6aa00, rc 0) 00000100:00100000:2.0:1789708697.059753:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708697.059940:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+8:10277:x1876645415772672:12345-192.168.202.53@tcp:101:bash.0 Request processed in 8305us (8909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708697.059950:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:3.0:1789708697.060523:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415772800 00000100:00100000:3.0:1789708697.060531:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415772800 00010000:00010000:3.0:1789708697.060560:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686642a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d484e expref: 8 pid: 6670 timeout: 362 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708697.060593:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00100000:3.0:1789708697.060601:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2361:x1876645415772800:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708697.060613:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708697.060633:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686642a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d484e expref: 8 pid: 6670 timeout: 362 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708697.060675:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686642a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d484e expref: 8 pid: 6670 timeout: 362 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708697.060700:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686642a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d484e expref: 8 pid: 6670 timeout: 362 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708697.060714:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708697.060718:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708697.060725:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c6866431 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4855 expref: 7 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708697.060747:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c6866431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4855 expref: 7 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708697.060782:0:8435:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c6866431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4855 expref: 7 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708697.060795:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f510700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8435:1876645426284160:192.168.202.53@tcp:105: 00000100:00100000:3.0:1789708697.060853:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13083870c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708697.062931:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708697.063046:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f510700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8435:1876645426284160:192.168.202.53@tcp:105: 00010000:00010000:1.0:1789708697.063068:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708697.063125:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2361:x1876645415772800:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 2524us (3373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708697.063136:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00100000:1.0:1789708697.063171:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415773056 00000100:00100000:1.0:1789708697.063177:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415773056 00000100:00100000:1.0:1789708697.063228:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:1.0:1789708697.063235:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+12:10277:x1876645415773056:12345-192.168.202.53@tcp:35:bash.0 00000100:00100000:1.0:1789708697.063527:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+13:10277:x1876645415773056:12345-192.168.202.53@tcp:35:bash.0 Request processed in 291us (602us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789708697.063534:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:1.0:1789708697.162431:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708697.162557:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415773312 00000100:00100000:3.0:1789708697.162567:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415773312 00000100:00100000:3.0:1789708697.162632:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:3.0:1789708697.162641:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+13:10287:x1876645415773312:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1789708697.162700:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708697.162719:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866438 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d485c expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708697.162817:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789708697.162931:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866438 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d485c expref: 15 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708697.162944:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38000) 00010000:00010000:3.0:1789708697.162947:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789708697.162951:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866438 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d485c expref: 15 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708697.162980:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39e00, rc 0) 00000100:00100000:3.0:1789708697.163368:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+14:10287:x1876645415773312:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 727us (943us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1789708697.163375:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:3.0:1789708697.167063:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708697.168050:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415773568 00000100:00100000:1.0:1789708697.168061:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415773568 00000100:00100000:1.0:1789708697.168152:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:1.0:1789708697.168162:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+14:10287:x1876645415773568:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:1.0:1789708697.168439:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+15:10287:x1876645415773568:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 277us (1383us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789708697.168446:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:2.0:1789708697.252465:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708697.252573:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415773696 00000100:00100000:1.0:1789708697.252583:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415773696 00000100:00100000:1.0:1789708697.252643:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00100000:1.0:1789708697.252677:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+15:10293:x1876645415773696:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1789708697.252700:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708697.252719:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866446 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4863 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.252793:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c686644d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.252805:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c686644d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.252831:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c686644d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708697.252862:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789708697.252865:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789708697.252880:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c686644d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.252902:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866446 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4863 expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.252917:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c686644d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4863 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.252924:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:1.0:1789708697.252927:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708697.252930:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4600, rc 0) 00000100:00100000:1.0:1789708697.252987:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+16:10293:x1876645415773696:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 336us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708697.252994:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00100000:0.0:1789708697.263331:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708697.263868:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415773952 00000100:00100000:2.0:1789708697.263878:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415773952 00000100:00100000:2.0:1789708697.263935:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:2.0:1789708697.263944:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+16:10293:x1876645415773952:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708697.263964:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708697.263982:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866454 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d486a expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.264122:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c686645b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.264136:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c686645b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.264147:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c686645b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708697.264157:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789708697.264286:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866454 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d486a expref: 19 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.264302:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c686645b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d486a expref: 18 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.264309:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14148f3100) 00010000:00010000:2.0:1789708697.264312:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708697.264315:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6bc00, rc 0) 00000100:00100000:2.0:1789708697.264456:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+18:10293:x1876645415773952:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 512us (1133us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789708697.264463:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:1.0:1789708697.280191:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708697.280240:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708697.280337:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415774080 00000100:00100000:2.0:1789708697.280347:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415774080 00000100:00100000:2.0:1789708697.280412:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:2.0:1789708697.280422:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+18:2363:x1876645415774080:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708697.280437:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708697.280483:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c686645b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d486a expref: 18 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.280502:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14148f3100) 00010000:00010000:2.0:1789708697.280506:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708697.280561:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+17:2363:x1876645415774080:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 140us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708697.280568:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:3.0:1789708697.282016:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415774336 00000100:00100000:3.0:1789708697.282024:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415774336 00000100:00100000:3.0:1789708697.282076:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:3.0:1789708697.282085:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+17:10293:x1876645415774336:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1789708697.282110:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708697.282128:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866469 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4871 expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708697.282220:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866470 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708697.282234:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708697.282971:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708697.282988:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789708697.283542:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866469 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4871 expref: 20 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708697.283562:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4871 expref: 19 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708697.283584:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14148f3100) 00010000:00010000:3.0:1789708697.283586:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789708697.283591:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38200, rc 0) 00000100:00100000:3.0:1789708697.283679:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+19:10293:x1876645415774336:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1594us (3438us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789708697.283688:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:3.0:1789708697.293366:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708697.293488:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415774464 00000100:00100000:2.0:1789708697.293498:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415774464 00000100:00100000:2.0:1789708697.293558:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:2.0:1789708697.293569:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2362:x1876645415774464:12345-192.168.202.53@tcp:1:lfs.0 00010000:00010000:2.0:1789708697.293617:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c686647e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.293637:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c6866431 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4855 expref: 7 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.293646:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789708697.293692:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708697.293698:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c686647e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.293735:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c6866431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4855 expref: 7 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.293762:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c6866431 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4855 expref: 7 pid: 10424 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708697.293792:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434bc9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1876645426284288:192.168.202.53@tcp:104: 00000100:00100000:0.0:1789708697.294174:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405876c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708697.317113:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434bc9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6670:1876645426284288:192.168.202.53@tcp:104: 00010000:00010000:0.0:1789708697.317146:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c686647e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708697.320494:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708697.320623:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415774592 00000100:00100000:0.0:1789708697.320635:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415774592 00002000:00100000:0.0:1789708697.320717:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8a143f510700 x1876645415774592/t0(0) o4->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:83/0 lens 504/0 e 0 to 0 dl 1789708708 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789708697.320742:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a143f510700 with x1876645415774592 ext(0->12) 00010000:00010000:0.0:1789708697.320752:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c6866431 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4855 expref: 8 pid: 10424 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.320770:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c6866431 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4855 expref: 8 pid: 10424 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708697.320779:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a143f510700 00000100:00100000:0.0:1789708697.320810:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:0.0:1789708697.320822:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2361:x1876645415774592:12345-192.168.202.53@tcp:4:lfs.0 00000100:00100000:1.0:1789708697.353062:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789708697.356631:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143ec30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426284672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789708697.356741:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708697.356840:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426284672 00000100:00100000:3.0:1789708697.356850:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426284672 00000100:00100000:3.0:1789708697.356906:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789708697.356915:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426284672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789708697.356959:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708697.357003:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426284672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708697.357022:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789708697.357073:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143ec30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426284672:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789708697.359787:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708697.381915:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876645426284544:0@lo:400:kworker.0 00000100:00100000:1.0:1789708697.382934:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708697.394478:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426284928:0@lo:400:kworker.0 00000100:00100000:2.0:1789708697.394615:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708697.396542:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f271f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876645426284800:0@lo:400:kworker.0 00000100:00100000:3.0:1789708697.398224:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708697.400087:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789708697.400104:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876645426285056:0@lo:400:kworker.0 00000100:00100000:2.0:1789708697.400161:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708697.404984:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426284416:0@lo:400:kworker.0 00000100:00100000:0.0:1789708697.405081:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708697.405118:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426284416 00000100:00100000:0.0:1789708697.405126:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426284416 00000100:00100000:0.0:1789708697.405175:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789708697.405185:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3287:x1876645426284416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708697.405233:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3287:x1876645426284416:12345-0@lo:400:kworker.0 Request processed in 49us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708697.405240:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789708697.405293:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426284416:0@lo:400:kworker.0 00000100:00100000:0.0:1789708697.418166:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426284928 00000100:00100000:0.0:1789708697.418198:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426284928 00000100:00100000:0.0:1789708697.418285:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789708697.418296:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426284928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708697.418752:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426284544 00000100:00100000:1.0:1789708697.418768:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426284544 00000100:00100000:1.0:1789708697.418836:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426284800 00000100:00100000:1.0:1789708697.418853:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426284800 00000100:00100000:1.0:1789708697.418883:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426285056 00000100:00100000:1.0:1789708697.418886:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426285056 00000100:00100000:1.0:1789708697.418905:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789708697.418914:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876645426284544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708697.419140:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426284928:12345-0@lo:400:kworker.0 Request processed in 841us (24520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708697.419152:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789708697.421002:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789708697.421038:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876645426284800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708697.421874:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876645426284800:12345-0@lo:400:kworker.0 Request processed in 844us (23650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708697.421874:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876645426284544:12345-0@lo:400:kworker.0 Request processed in 2957us (38939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708697.421883:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789708697.421986:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876645426284544:0@lo:400:kworker.0 00000100:00100000:1.0:1789708697.422721:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789708697.422727:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789708697.422742:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876645426285056:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789708697.422744:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708697.422798:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876645426285056:12345-0@lo:400:kworker.0 Request processed in 63us (22636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708697.422805:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789708697.422926:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f271f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876645426284800:0@lo:400:kworker.0 00000100:00100000:2.0:1789708697.423169:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876645426285056:0@lo:400:kworker.0 00000100:00100000:2.0:1789708697.423184:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426284928:0@lo:400:kworker.0 00000001:00100000:3.0:1789708697.588802:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 14bb7f14-3461-47f6-86c9-db3f545050ad 00000001:00080000:3.0:1789708697.652196:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1789708697.652334:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2361:x1876645415774592:12345-192.168.202.53@tcp:4:lfs.0 Request processed in 331509us (331843us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789708697.652352:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00002000:00100000:3.0:1789708697.652366:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8a143f510700 x1876645415774592/t4294967299(0) o4->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:83/0 lens 504/448 e 0 to 0 dl 1789708708 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789708697.652377:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a143f510700 with x1876645415774592 ext(0->12) 00010000:00010000:3.0:1789708697.652387:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c6866431 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4855 expref: 7 pid: 10424 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708697.652405:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c6866431 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4855 expref: 7 pid: 10424 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789708697.652414:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a143f510700 00010000:00010000:1.0:1789708697.722976:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708697.740695:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708697.740857:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415774720 00000100:00100000:1.0:1789708697.740868:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415774720 00010000:00010000:1.0:1789708697.740911:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c6866431 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4855 expref: 7 pid: 10424 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708697.740957:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:1.0:1789708697.740967:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2364:x1876645415774720:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708697.740983:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789708697.741015:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789708697.741018:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789708697 00002000:00010000:1.0:1789708697.741021:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789708697 00002000:00010000:1.0:1789708697.741023:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789708697 00002000:00010000:1.0:1789708697.741025:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1789708697.741032:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c6866431 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4855 expref: 7 pid: 10424 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.741052:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c6866431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4855 expref: 7 pid: 10424 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.741101:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c6866431 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4855 expref: 7 pid: 10424 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.741121:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708697.741125:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708697.741130:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c686647e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.741139:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c686647e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.741221:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708697.741292:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2364:x1876645415774720:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 326us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708697.741300:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 36 00010000:00010000:0.0:1789708697.749197:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c686647e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.749220:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c686647e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.749416:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c686647e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.749426:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c686647e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.749435:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c686647e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.749443:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6bc00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708697.749473:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c686647e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.749483:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c686647e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.749503:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c686647e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.749511:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c686647e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708697.749636:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2362:x1876645415774464:12345-192.168.202.53@tcp:1:lfs.0 Request processed in 456064us (456275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708697.749666:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:2.0:1789708697.752984:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708697.753087:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415774976 00000100:00100000:3.0:1789708697.753098:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415774976 00000100:00100000:3.0:1789708697.753159:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:3.0:1789708697.753170:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+19:10293:x1876645415774976:12345-192.168.202.53@tcp:35:lfs.0 00000004:00010000:3.0:1789708697.753240:0:5822:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4871 expref: 19 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789708697.753583:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1789708697.753703:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1789708697.758234:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1789708697.758347:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866485 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708697.758368:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c6866415 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4847 expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708697.758378:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866485 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708697.758422:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c6866415 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4847 expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708697.758438:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c6866415 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4847 expref: 23 pid: 5819 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708697.758451:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f287b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5822:1876645426285184:192.168.202.53@tcp:104: 00000100:00100000:3.0:1789708697.758564:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308387900 going to sleep for 11 seconds 00000100:00100000:3.0:1789708697.763701:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708697.763913:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415775104 00000100:00100000:2.0:1789708697.763925:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415775104 00010000:00010000:2.0:1789708697.763970:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c6866415 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4847 expref: 24 pid: 5819 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708697.764014:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:2.0:1789708697.764025:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+24:2361:x1876645415775104:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708697.764043:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708697.764050:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c6866415 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4847 expref: 24 pid: 5819 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.764064:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c6866415 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4847 expref: 24 pid: 5819 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.764106:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14148f3100) 00010000:00010000:2.0:1789708697.764112:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866485 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.764120:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866485 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.764127:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866485 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.764146:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708697.764210:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+24:2361:x1876645415775104:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 187us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708697.764218:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 37 00010000:00010000:1.0:1789708697.764393:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c6866415 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4847 expref: 23 pid: 5819 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708697.764411:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f287b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5822:1876645426285184:192.168.202.53@tcp:104: 00010000:00010000:1.0:1789708697.764430:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866485 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.764439:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866485 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.764446:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866485 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789708697.764590:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1789708697.767322:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1789708697.767503:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143efa1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1876645426285312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789708697.767633:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708697.767690:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708697.769131:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426285312 00000100:00100000:2.0:1789708697.769144:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426285312 00000100:00100000:2.0:1789708697.769200:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708697.769210:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5822:x1876645426285312:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789708697.769345:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5822:x1876645426285312:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 136us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708697.769353:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708697.769711:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143efa1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1876645426285312:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789708697.781970:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1789708697.782206:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434bc8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1876645426285440:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789708697.782430:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708697.782532:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402f31480 going to sleep for 11 seconds 00000100:00100000:3.0:1789708697.782642:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426285440 00000100:00100000:3.0:1789708697.782693:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426285440 00000100:00100000:3.0:1789708697.782740:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789708697.782760:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5822:x1876645426285440:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789708697.783033:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5822:x1876645426285440:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 274us (603us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789708697.783049:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789708697.783688:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434bc8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1876645426285440:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789708697.785194:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1789708697.785332:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866485 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.785345:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866485 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.785353:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866485 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.785359:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708697.785364:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866485 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.785372:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866485 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.785388:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14148f3100) 00010000:00010000:2.0:1789708697.785391:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789708697.785396:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866485 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708697.785403:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866485 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789708697.787958:0:5822:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789708697.788286:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789708697.788302:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 263585651216ns, next at 264585647385ns, rc = 0 00000001:00080000:2.0:1789708697.788313:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1789708697.788374:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14148f3100) 00010000:00010000:2.0:1789708697.788379:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789708697.788391:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866470 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4871 expref: 27 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708697.791488:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+26:10293:x1876645415774976:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 38307us (38501us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789708697.795270:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00000020:00080000:2.0:1789708697.795284:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789708697.813059:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708697.813221:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415775232 00000100:00100000:1.0:1789708697.813232:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415775232 00000100:00100000:1.0:1789708697.813305:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:1.0:1789708697.813315:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+26:10293:x1876645415775232:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1789708697.813341:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708697.813363:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c686648c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4878 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.813425:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c686648c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4878 expref: 27 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.813439:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c686648c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4878 expref: 27 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708697.813457:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:1.0:1789708697.813460:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708697.813464:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5000, rc 0) 00000100:00100000:1.0:1789708697.814404:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+27:10293:x1876645415775232:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1086us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708697.814413:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:1.0:1789708697.823905:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708697.824027:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415775488 00000100:00100000:2.0:1789708697.824037:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415775488 00000100:00100000:2.0:1789708697.824093:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:2.0:1789708697.824103:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14069fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+27:10293:x1876645415775488:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1789708697.824333:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14069fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+28:10293:x1876645415775488:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 231us (593us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1789708697.824341:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:2.0:1789708697.982694:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708697.983337:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415775744 00000100:00100000:0.0:1789708697.983348:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415775744 00000100:00100000:0.0:1789708697.983411:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:0.0:1789708697.983421:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+28:10303:x1876645415775744:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1789708697.983872:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708697.983894:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866493 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d487f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708697.983982:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789708697.984411:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866493 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d487f expref: 30 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.984428:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38000) 00010000:00010000:0.0:1789708697.984431:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789708697.984437:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866493 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d487f expref: 30 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708697.984627:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14014a8e00, rc 0) 00000100:00100000:0.0:1789708697.984792:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+29:10303:x1876645415775744:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1371us (2106us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1789708697.984801:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:0.0:1789708698.013645:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708698.013778:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415775872 00000100:00100000:2.0:1789708698.013789:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415775872 00000100:00100000:2.0:1789708698.013916:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:2.0:1789708698.013927:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+29:10303:x1876645415775872:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:2.0:1789708698.014025:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68664a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014043:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68664a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014055:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68664a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014178:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68664a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014201:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68664a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014209:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68664a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014722:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014733:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014741:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789708698.014786:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014799:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68664a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014806:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68664a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014813:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68664a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014819:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708698.014824:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68664a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014832:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68664a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014852:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:2.0:1789708698.014856:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708698.014861:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68664a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014868:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68664a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014882:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68664a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014889:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68664a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014895:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68664a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014901:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6ac00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708698.014904:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68664a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014911:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68664a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014918:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1414c38e00) 00010000:00010000:2.0:1789708698.014920:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708698.014923:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68664a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014929:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68664a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014955:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014962:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014968:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014973:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708698.014976:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014982:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.014989:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:2.0:1789708698.014991:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708698.014994:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.015012:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708698.015877:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+29:10303:x1876645415775872:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 1947us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708698.015888:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00080000:1.0:1789708698.019502:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708698.021860:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708698.021937:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415776128 00000100:00100000:2.0:1789708698.021947:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415776128 00000100:00100000:2.0:1789708698.022015:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:2.0:1789708698.022043:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+29:10303:x1876645415776128:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1789708698.022740:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+30:10303:x1876645415776128:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 698us (887us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789708698.022750:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:2.0:1789708698.080343:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708698.080639:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415776384 00000100:00100000:1.0:1789708698.080686:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415776384 00000100:00100000:1.0:1789708698.080747:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:1.0:1789708698.080757:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+30:10306:x1876645415776384:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1789708698.080782:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708698.080805:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c68664b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4886 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.080883:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c68664bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.080898:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c68664bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.080909:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c68664bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.080925:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c68664c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.080932:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c68664c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.080939:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c68664c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081061:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c68664cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081071:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c68664cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081108:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c68664cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708698.081118:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789708698.081215:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c68664bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081223:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c68664bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081416:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c68664bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081424:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5a00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708698.081429:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c68664bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081436:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c68664bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081449:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:1.0:1789708698.081452:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708698.081457:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c68664bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081532:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c68664bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081611:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c68664c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081619:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c68664c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081632:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c68664c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081637:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708698.081640:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c68664c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081647:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c68664c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081804:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a14033c4a00) 00010000:00010000:1.0:1789708698.081807:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708698.081810:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c68664c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081816:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c68664c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081864:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c68664b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4886 expref: 33 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081878:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c68664cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4886 expref: 32 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.081885:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:1.0:1789708698.081887:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708698.081890:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4c00, rc 0) 00000100:00100000:1.0:1789708698.081959:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+32:10306:x1876645415776384:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1202us (1625us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1789708698.081976:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:0.0:1789708698.090324:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708698.090464:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415776512 00000100:00100000:2.0:1789708698.090483:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415776512 00000100:00100000:2.0:1789708698.090551:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 48 00000100:00100000:2.0:1789708698.090561:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+32:10306:x1876645415776512:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:2.0:1789708698.090628:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.090646:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.090988:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.091026:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.091033:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.091041:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.091048:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708698.091053:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.091076:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.091145:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:2.0:1789708698.091149:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789708698.091155:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.091162:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68664d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708698.091233:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+32:10306:x1876645415776512:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 672us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708698.091242:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 48 00000100:00100000:3.0:1789708698.094284:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708698.094417:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415776768 00000100:00100000:2.0:1789708698.094429:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415776768 00000100:00100000:2.0:1789708698.094504:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:2.0:1789708698.094521:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+32:10306:x1876645415776768:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1789708698.094809:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+33:10306:x1876645415776768:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 288us (536us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789708698.094817:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:0.0:1789708698.477133:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708698.477198:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415777024 00000100:00100000:3.0:1789708698.477209:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415777024 00000100:00100000:3.0:1789708698.477409:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:3.0:1789708698.477421:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+33:10337:x1876645415777024:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:3.0:1789708698.477447:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708698.477479:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c68664e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d488d expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708698.477580:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68664e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708698.477595:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68664e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708698.477608:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68664e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708698.477618:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789708698.477807:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c68664e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d488d expref: 36 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708698.477826:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68664e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d488d expref: 35 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708698.477835:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:3.0:1789708698.477838:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708698.477857:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38800, rc 0) 00000100:00100000:3.0:1789708698.477928:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+35:10337:x1876645415777024:12345-192.168.202.53@tcp:101:cat.0 Request processed in 508us (804us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789708698.477937:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:0.0:1789708698.487957:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708698.488071:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708698.488178:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415777408 00000100:00100000:1.0:1789708698.488188:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415777408 00000100:00100000:1.0:1789708698.488256:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:1.0:1789708698.488267:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+35:10337:x1876645415777408:12345-192.168.202.53@tcp:35:cat.0 00000100:00100000:1.0:1789708698.488581:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+36:10337:x1876645415777408:12345-192.168.202.53@tcp:35:cat.0 Request processed in 315us (509us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789708698.488589:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:2.0:1789708698.488886:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415777152 00000100:00100000:2.0:1789708698.488892:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415777152 00000100:00100000:2.0:1789708698.488930:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:2.0:1789708698.488938:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1407f54850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+36:2364:x1876645415777152:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708698.488949:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708698.488972:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68664e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d488d expref: 36 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.489024:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:2.0:1789708698.489033:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708698.489056:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1407f54850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+35:2364:x1876645415777152:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 119us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708698.489064:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:1.0:1789708698.570059:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708698.570526:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415777664 00000100:00100000:0.0:1789708698.570537:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415777664 00000100:00100000:0.0:1789708698.570604:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:0.0:1789708698.570614:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+35:10343:x1876645415777664:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:0.0:1789708698.570639:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708698.570642:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789708698.570713:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c686644d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4863 expref: 35 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708698.570730:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:0.0:1789708698.570748:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708698.570763:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c68664f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4894 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708698.570855:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68664fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708698.570869:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c68664cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4886 expref: 35 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708698.570877:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68664fc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708698.570907:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c68664cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4886 expref: 35 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708698.570921:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c68664cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4886 expref: 35 pid: 5819 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708698.570935:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f273100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1876645426285568:192.168.202.53@tcp:104: 00000100:00100000:0.0:1789708698.571040:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308463d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708698.576157:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708698.576276:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f273100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1876645426285568:192.168.202.53@tcp:104: 00010000:00010000:1.0:1789708698.576306:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68664fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708698.576380:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415777792 00000100:00100000:2.0:1789708698.576388:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415777792 00010000:00010000:2.0:1789708698.576421:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c68664cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4886 expref: 36 pid: 5819 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708698.576468:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 38 00000100:00100000:2.0:1789708698.576477:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+36:2362:x1876645415777792:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708698.576494:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708698.576500:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c68664cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4886 expref: 36 pid: 5819 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.576522:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c68664cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4886 expref: 36 pid: 5819 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.576545:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c68664cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4886 expref: 36 pid: 5819 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.576559:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:2.0:1789708698.576564:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68664fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.576591:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68664fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.576598:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68664fc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.576627:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708698.576720:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+35:2362:x1876645415777792:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 242us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708698.576728:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 38 00010000:00010000:1.0:1789708698.576970:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68664fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.576979:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68664fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708698.577012:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789708698.577184:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c68664f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4894 expref: 36 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.577201:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68664fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4894 expref: 35 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708698.577210:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:1.0:1789708698.577218:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789708698.577221:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14014a9c00, rc 0) 00000100:00100000:1.0:1789708698.577247:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+35:10343:x1876645415777664:12345-192.168.202.53@tcp:101:dd.0 Request processed in 6636us (7197us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789708698.577255:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:3.0:1789708698.580702:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708698.580902:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415778048 00000100:00100000:2.0:1789708698.580913:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415778048 00000100:00100000:2.0:1789708698.580975:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:2.0:1789708698.580986:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+35:10343:x1876645415778048:12345-192.168.202.53@tcp:36:dd.0 00010000:00010000:2.0:1789708698.581304:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686650a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.581320:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686650a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708698.581331:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686650a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789708698.581383:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1789708698.581407:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025df941c reply state 000000005481ef2c transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686650a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708698.581415:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789708698.581907:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+38:10343:x1876645415778048:12345-192.168.202.53@tcp:36:dd.0 Request processed in 920us (1262us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789708698.581932:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 51 00000020:00080000:2.0:1789708698.581938:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789708698.592391:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686650a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708698.592416:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686650a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708698.592426:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686650a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708698.592455:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708698.592475:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686650a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708698.592486:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686650a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708698.592520:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:0.0:1789708698.592524:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708698.592530:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686650a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708698.592538:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686650a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708698.747747:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708699.024429:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708699.024685:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415778176 00000100:00100000:1.0:1789708699.024696:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415778176 00000100:00100000:1.0:1789708699.024764:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:1.0:1789708699.024775:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+37:10357:x1876645415778176:12345-192.168.202.53@tcp:101:stat.0 00010000:00010000:1.0:1789708699.024800:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708699.024821:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866511 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d489b expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.024882:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866518 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.024897:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866518 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.024908:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866518 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.024923:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c686651f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.024931:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c686651f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.024937:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c686651f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.025049:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866526 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.025061:0:7140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68664fc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4894 expref: 38 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.025070:0:7140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866526 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.025103:0:7140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68664fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4894 expref: 38 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.025116:0:7140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68664fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4894 expref: 38 pid: 5819 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708699.025130:0:7140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143efa2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7140:1876645426285696:192.168.202.53@tcp:104: 00000100:00100000:1.0:1789708699.025380:0:7140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789708699.043901:0:7140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143efa2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7140:1876645426285696:192.168.202.53@tcp:104: 00010000:00010000:3.0:1789708699.043934:0:7140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866526 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708699.052334:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708699.053110:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415778432 00000100:00100000:1.0:1789708699.053122:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415778432 00000100:00100000:1.0:1789708699.053191:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:1.0:1789708699.053202:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+39:5591:x1876645415778432:12345-192.168.202.53@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789708699.054153:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+40:5591:x1876645415778432:12345-192.168.202.53@tcp:35:ldlm_bl.0 Request processed in 948us (1824us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1789708699.054164:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:1.0:1789708699.065205:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708699.065312:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415778560 00000100:00100000:2.0:1789708699.065324:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415778560 00010000:00010000:2.0:1789708699.065364:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68664fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4894 expref: 40 pid: 5819 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708699.065408:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:2.0:1789708699.065417:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+40:2361:x1876645415778560:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708699.065443:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708699.065458:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68664fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4894 expref: 40 pid: 5819 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.065473:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68664fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4894 expref: 40 pid: 5819 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.065505:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68664fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4894 expref: 40 pid: 5819 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.065533:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:2.0:1789708699.065539:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866526 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.065550:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.065559:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866526 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.065613:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708699.065714:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+39:2361:x1876645415778560:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 296us (519us total) trans 0 rc 0/0 00010000:00010000:3.0:1789708699.065940:0:7140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.065950:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708699.066006:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789708699.066011:0:7140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789708699.066049:0:7140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.066062:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.066072:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866518 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.066080:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866518 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.066087:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866518 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.066100:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708699.066104:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866518 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.066112:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866518 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.066123:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:3.0:1789708699.066126:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708699.066131:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866518 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.066138:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866518 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.066150:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c686651f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.066156:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c686651f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.066163:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c686651f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.066168:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708699.066171:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c686651f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.066177:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c686651f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.066194:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a14033c4a00) 00010000:00010000:3.0:1789708699.066197:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708699.066200:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c686651f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.066207:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c686651f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.066243:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866511 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d489b expref: 40 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.066257:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866526 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d489b expref: 39 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.066264:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:3.0:1789708699.066267:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708699.066269:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4c00, rc 0) 00000100:00100000:3.0:1789708699.066296:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+39:10357:x1876645415778176:12345-192.168.202.53@tcp:101:stat.0 Request processed in 41524us (41878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708699.066305:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:2.0:1789708699.066643:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:0.0:1789708699.313163:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708699.313282:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415778816 00000100:00100000:1.0:1789708699.313310:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415778816 00000100:00100000:1.0:1789708699.313379:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:1.0:1789708699.313390:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+38:10363:x1876645415778816:12345-192.168.202.53@tcp:36:truncate.0 00010000:00010000:1.0:1789708699.313450:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708699.313492:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866526 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d489b expref: 38 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.313511:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:1.0:1789708699.313517:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708699.313784:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686652d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.313797:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686652d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.313806:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686652d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789708699.313856:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1789708699.313883:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039e98241 reply state 00000000b87c010e transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686652d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708699.313893:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789708699.314139:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+40:10363:x1876645415778816:12345-192.168.202.53@tcp:36:truncate.0 Request processed in 750us (984us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789708699.314148:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 53 00000020:00080000:1.0:1789708699.314153:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789708699.316108:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686652d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.316125:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686652d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.316149:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686652d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.316155:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708699.316159:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686652d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.316166:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686652d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.316180:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:1.0:1789708699.316183:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708699.316187:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686652d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.316194:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686652d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708699.515724:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789708699.532849:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708699.533021:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415778944 00000100:00100000:3.0:1789708699.533032:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415778944 00000100:00100000:3.0:1789708699.533101:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:3.0:1789708699.533112:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+39:10377:x1876645415778944:12345-192.168.202.53@tcp:101:stat.0 00010000:00010000:3.0:1789708699.533137:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708699.533159:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866534 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d48a2 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533256:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c686653b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533271:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c686653b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533282:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c686653b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533297:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866542 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533305:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533312:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533397:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866549 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533405:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533412:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708699.533445:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789708699.533450:0:11601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789708699.533467:0:11601:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533489:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533510:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c686653b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533518:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c686653b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533524:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c686653b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533531:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708699.533535:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c686653b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533543:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c686653b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533556:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:3.0:1789708699.533559:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708699.533564:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c686653b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533571:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c686653b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533585:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533590:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866542 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533602:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533608:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708699.533611:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533617:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866542 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533626:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1411b4af00) 00010000:00010000:3.0:1789708699.533628:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708699.533631:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866542 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533638:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866542 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533719:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866534 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48a2 expref: 41 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533733:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48a2 expref: 40 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.533741:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:3.0:1789708699.533744:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708699.533746:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38800, rc 0) 00000100:00100000:3.0:1789708699.533815:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+40:10377:x1876645415778944:12345-192.168.202.53@tcp:101:stat.0 Request processed in 706us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708699.533832:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:3.0:1789708699.618125:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708699.618244:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415779200 00000100:00100000:1.0:1789708699.618256:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415779200 00000100:00100000:1.0:1789708699.618327:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:1.0:1789708699.618338:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+40:10387:x1876645415779200:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1789708699.618360:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708699.618382:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866550 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d48a9 expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708699.618513:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789708699.618642:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866550 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48a9 expref: 42 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.618730:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38000) 00010000:00010000:1.0:1789708699.618733:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708699.618740:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866550 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48a9 expref: 42 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708699.618755:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4c00, rc 0) 00000100:00100000:1.0:1789708699.618832:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+41:10387:x1876645415779200:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 495us (716us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1789708699.618841:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:1.0:1789708699.625389:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708699.626833:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415779456 00000100:00100000:3.0:1789708699.626847:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415779456 00000100:00100000:3.0:1789708699.626913:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:3.0:1789708699.626924:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+41:10387:x1876645415779456:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:3.0:1789708699.627454:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+42:10387:x1876645415779456:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 529us (2072us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1789708699.627464:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:2.0:1789708699.707192:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708699.707576:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415779712 00000100:00100000:0.0:1789708699.707586:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415779712 00000100:00100000:0.0:1789708699.707731:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:0.0:1789708699.707743:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+42:10393:x1876645415779712:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1789708699.707770:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708699.707790:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c686655e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d48b0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.707890:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866565 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.707920:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866549 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48a2 expref: 43 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.707928:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866565 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.707960:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48a2 expref: 43 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.707972:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866549 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48a2 expref: 43 pid: 11601 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708699.708000:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e163100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1876645426285824:192.168.202.53@tcp:104: 00000100:00100000:0.0:1789708699.708085:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13084633c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708699.715931:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708699.717789:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e163100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1876645426285824:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708699.717822:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866565 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708699.718001:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415779840 00000100:00100000:3.0:1789708699.718009:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415779840 00010000:00010000:3.0:1789708699.718049:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866549 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48a2 expref: 44 pid: 11601 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708699.718093:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:3.0:1789708699.718103:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e160700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+44:2361:x1876645415779840:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708699.718118:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708699.718125:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866549 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48a2 expref: 44 pid: 11601 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.718137:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48a2 expref: 44 pid: 11601 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.718160:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866549 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48a2 expref: 44 pid: 11601 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.718196:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:3.0:1789708699.718201:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866565 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.718212:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866565 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.718232:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866565 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.718260:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708699.718328:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e160700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+43:2361:x1876645415779840:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 226us (2406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708699.718336:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 40 00010000:00010000:2.0:1789708699.718396:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866565 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.718405:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866565 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708699.718423:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789708699.718590:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c686655e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48b0 expref: 44 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.718607:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866565 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48b0 expref: 43 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.718615:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:2.0:1789708699.718618:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789708699.718620:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14014a8e00, rc 0) 00000100:00100000:2.0:1789708699.718646:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+43:10393:x1876645415779712:12345-192.168.202.53@tcp:101:bash.0 Request processed in 10907us (11465us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789708699.718716:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:1.0:1789708699.724554:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708699.724694:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415780096 00000100:00100000:2.0:1789708699.724705:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415780096 00000100:00100000:2.0:1789708699.724772:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:2.0:1789708699.724783:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+43:10393:x1876645415780096:12345-192.168.202.53@tcp:36:bash.0 00010000:00010000:2.0:1789708699.725082:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866573 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.725101:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866573 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.725113:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866573 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789708699.725163:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1789708699.725189:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd4fb338 reply state 000000002b2d6f8f transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866573 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708699.725198:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789708699.725283:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+46:10393:x1876645415780096:12345-192.168.202.53@tcp:36:bash.0 Request processed in 501us (737us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789708699.725290:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 57 00000020:00080000:2.0:1789708699.725295:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789708699.727148:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866573 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.727163:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866573 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.727171:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866573 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.727177:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708699.727181:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866573 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.727189:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866573 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.727228:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:0.0:1789708699.727230:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708699.727235:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866573 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.727241:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866573 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708699.735585:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708699.735683:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415780224 00000100:00100000:0.0:1789708699.735695:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415780224 00000100:00100000:0.0:1789708699.735761:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00100000:0.0:1789708699.735771:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+45:10393:x1876645415780224:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1789708699.735795:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708699.735814:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c686657a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d48b7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.735894:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866581 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.735909:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866565 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48b0 expref: 46 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.735918:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866581 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.735951:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866565 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48b0 expref: 46 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.735965:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866565 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48b0 expref: 46 pid: 5820 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708699.736006:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e161c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1876645426285952:192.168.202.53@tcp:104: 00000100:00100000:0.0:1789708699.736094:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308463e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708699.738311:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e161c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1876645426285952:192.168.202.53@tcp:104: 00010000:00010000:0.0:1789708699.738341:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866581 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708699.739197:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708699.739566:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415780352 00000100:00100000:2.0:1789708699.739575:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415780352 00010000:00010000:2.0:1789708699.739609:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866565 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48b0 expref: 47 pid: 5820 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708699.739646:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00100000:2.0:1789708699.739686:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+47:2362:x1876645415780352:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708699.739701:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708699.739708:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866565 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48b0 expref: 47 pid: 5820 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.739720:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866565 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48b0 expref: 47 pid: 5820 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.739740:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6866565 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48b0 expref: 47 pid: 5820 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.739756:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:2.0:1789708699.739760:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866581 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.739769:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.739777:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866581 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.739796:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708699.739854:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+46:2362:x1876645415780352:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 171us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708699.739862:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 41 00010000:00010000:0.0:1789708699.739925:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.739934:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708699.739977:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789708699.739992:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789708699.740011:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.740043:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c686657a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48b7 expref: 46 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.740057:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866581 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48b7 expref: 45 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.740064:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:0.0:1789708699.740067:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708699.740070:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14014a9200, rc 0) 00000100:00100000:0.0:1789708699.740095:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+45:10393:x1876645415780224:12345-192.168.202.53@tcp:101:bash.0 Request processed in 4325us (4520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708699.740108:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00100000:1.0:1789708699.744113:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708699.744282:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415780608 00000100:00100000:2.0:1789708699.744292:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415780608 00000100:00100000:2.0:1789708699.744351:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:2.0:1789708699.744362:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14069fa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+45:10393:x1876645415780608:12345-192.168.202.53@tcp:35:bash.0 00000100:00100000:2.0:1789708699.744680:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14069fa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+46:10393:x1876645415780608:12345-192.168.202.53@tcp:35:bash.0 Request processed in 319us (575us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789708699.744689:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 15 00010000:00010000:2.0:1789708699.770917:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708699.863428:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708699.863529:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415780864 00000100:00100000:2.0:1789708699.863539:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415780864 00000100:00100000:2.0:1789708699.863698:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:2.0:1789708699.863710:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+46:10403:x1876645415780864:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708699.863736:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708699.863755:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866588 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d48be expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708699.863848:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789708699.863969:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866588 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48be expref: 48 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.864421:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38000) 00010000:00010000:2.0:1789708699.864426:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789708699.864433:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866588 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48be expref: 48 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.864456:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6ba00, rc 0) 00000100:00100000:2.0:1789708699.864580:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+47:10403:x1876645415780864:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 871us (1160us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1789708699.864598:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:1.0:1789708699.882051:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708699.882373:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415780992 00000100:00100000:3.0:1789708699.882383:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415780992 00000100:00100000:3.0:1789708699.882456:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:3.0:1789708699.882466:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+47:10403:x1876645415780992:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:3.0:1789708699.882541:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866596 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882557:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866596 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882568:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866596 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882583:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c686659d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882614:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c686659d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882621:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c686659d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882753:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68665a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882762:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68665a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882769:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68665a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708699.882808:0:7140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68665a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882822:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866596 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882829:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866596 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882837:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866596 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882844:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708699.882848:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866596 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882855:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866596 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882874:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:3.0:1789708699.882877:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708699.882882:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866596 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882889:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866596 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882901:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c686659d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882907:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c686659d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882913:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c686659d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882918:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708699.882921:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c686659d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882927:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c686659d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882933:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1411b4af00) 00010000:00010000:3.0:1789708699.882936:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708699.882938:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c686659d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882944:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c686659d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882967:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68665a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882973:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68665a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882978:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68665a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.882995:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708699.882998:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68665a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.883004:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68665a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.883010:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:3.0:1789708699.883013:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708699.883016:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68665a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.883022:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68665a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708699.883114:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+47:10403:x1876645415780992:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 648us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708699.883123:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:1.0:1789708699.888161:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708699.888316:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415781248 00000100:00100000:2.0:1789708699.888342:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415781248 00000100:00100000:2.0:1789708699.888401:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:2.0:1789708699.888420:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+47:10403:x1876645415781248:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1789708699.889031:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+48:10403:x1876645415781248:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 618us (877us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789708699.889041:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:1.0:1789708699.966571:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708699.967012:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415781504 00000100:00100000:0.0:1789708699.967024:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415781504 00000100:00100000:0.0:1789708699.967098:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:0.0:1789708699.967113:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+48:10406:x1876645415781504:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1789708699.967139:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708699.967162:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c68665ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d48c5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.967253:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68665b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.967268:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68665b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.967280:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68665b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.967294:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68665b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.967299:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68665b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.967305:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68665b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.967425:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c68665c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.967730:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c68665c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.967737:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c68665c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708699.967749:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789708699.967932:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68665b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.967938:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68665b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.967943:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68665b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.967946:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a8800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708699.967949:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68665b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.967953:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68665b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.967961:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:0.0:1789708699.967963:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708699.967966:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68665b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.967969:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68665b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.967978:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68665b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.968001:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68665b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.968007:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68665b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.968012:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a9c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708699.968015:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68665b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.968025:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68665b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.968036:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a14148f3700) 00010000:00010000:0.0:1789708699.968039:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708699.968041:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68665b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.968047:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68665b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.968095:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c68665ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48c5 expref: 51 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.968108:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c68665c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48c5 expref: 50 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708699.968114:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:0.0:1789708699.968117:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708699.968125:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14014a8e00, rc 0) 00000100:00100000:0.0:1789708699.968194:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+50:10406:x1876645415781504:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1086us (1632us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1789708699.968202:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:0.0:1789708699.974454:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708699.974498:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708699.974773:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415781632 00000100:00100000:2.0:1789708699.974783:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415781632 00000100:00100000:2.0:1789708699.974847:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 62 00000100:00100000:2.0:1789708699.974857:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+50:10406:x1876645415781632:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:2.0:1789708699.974926:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.974942:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.974954:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.974993:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.975001:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.975008:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.975015:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6ba00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708699.975019:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.975039:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.975053:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:2.0:1789708699.975056:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789708699.975060:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708699.975067:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708699.975274:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415781760 00000100:00100000:3.0:1789708699.975279:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415781760 00000100:00100000:3.0:1789708699.975315:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:3.0:1789708699.975330:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e163100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+51:2361:x1876645415781760:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708699.975356:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708699.975372:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c68665c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48c5 expref: 51 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708699.975385:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:3.0:1789708699.975388:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708699.975441:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e163100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+50:2361:x1876645415781760:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 113us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708699.975450:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:2.0:1789708699.975590:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+49:10406:x1876645415781632:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 734us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708699.975597:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 62 00000100:00100000:2.0:1789708699.980916:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708699.981108:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415782016 00000100:00100000:3.0:1789708699.981119:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415782016 00000100:00100000:3.0:1789708699.981174:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:3.0:1789708699.981184:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+49:10406:x1876645415782016:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:3.0:1789708699.981417:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+50:10406:x1876645415782016:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 234us (511us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789708699.981424:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:3.0:1789708700.247582:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708700.248456:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415782272 00000100:00100000:2.0:1789708700.248467:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415782272 00000100:00100000:2.0:1789708700.248571:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:2.0:1789708700.248582:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+50:10423:x1876645415782272:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:2.0:1789708700.248608:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708700.248629:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d48cc expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789708700.248840:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789708700.249375:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68665dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.249392:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68665dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.249432:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68665dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708700.249453:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789708700.250932:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48cc expref: 53 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.250959:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68665dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48cc expref: 52 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.250969:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:2.0:1789708700.250972:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789708700.250975:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6a000, rc 0) 00000100:00100000:2.0:1789708700.251127:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+52:10423:x1876645415782272:12345-192.168.202.53@tcp:101:cat.0 Request processed in 2545us (3554us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789708700.251136:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:3.0:1789708700.360774:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708700.360972:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415782400 00000100:00100000:0.0:1789708700.361011:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415782400 00000100:00100000:0.0:1789708700.361079:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 64 00000100:00100000:0.0:1789708700.361089:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+52:10425:x1876645415782400:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1789708700.361114:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708700.361134:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68665ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d48d3 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.361195:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68665f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.361210:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68665f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.361221:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68665f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708700.361255:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789708700.361259:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789708700.361287:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68665f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.361313:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68665ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48d3 expref: 54 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.361350:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68665f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48d3 expref: 53 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.361360:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:0.0:1789708700.361364:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708700.361367:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14014a8800, rc 0) 00000100:00100000:0.0:1789708700.361437:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+53:10425:x1876645415782400:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 350us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708700.361445:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 64 00000100:00100000:0.0:1789708700.369194:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708700.369291:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415782784 00000100:00100000:3.0:1789708700.369303:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415782784 00000100:00100000:3.0:1789708700.369361:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:3.0:1789708700.369371:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+53:10425:x1876645415782784:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:3.0:1789708700.370069:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+54:10425:x1876645415782784:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 698us (883us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789708700.370078:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:1.0:1789708700.386845:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708700.388402:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415782912 00000100:00100000:2.0:1789708700.388415:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415782912 00000100:00100000:1.0:1789708700.388721:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:1.0:1789708700.388735:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+54:10425:x1876645415782912:12345-192.168.202.53@tcp:103:lfs.0 00010000:00010000:1.0:1789708700.388753:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789708700.388778:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c6866581 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48b7 expref: 54 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708700.388822:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68665dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48cc expref: 53 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708700.388835:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c686648c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4878 expref: 52 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708700.388847:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4900) 00010000:00010000:1.0:1789708700.388858:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708700.388914:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+51:10425:x1876645415782912:12345-192.168.202.53@tcp:103:lfs.0 Request processed in 184us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708700.388923:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:0.0:1789708700.394500:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708700.399403:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415783040 00000100:00100000:2.0:1789708700.399428:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415783040 00000100:00100000:2.0:1789708700.400316:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 65 00000100:00100000:2.0:1789708700.400331:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+51:10425:x1876645415783040:12345-192.168.202.53@tcp:58:lfs.0 00010000:00010000:2.0:1789708700.401118:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.401138:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.401164:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789708700.401875:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789708700.402099:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789708700.402168:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789708700.407113:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+51:10425:x1876645415783040:12345-192.168.202.53@tcp:58:lfs.0 Request processed in 6774us (12619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708700.407129:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 65 00000040:00080000:3.0:1789708700.538874:0:11657:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789708700.538883:0:11657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789708700.538950:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789708700.538964:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789708700.539105:0:11657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f284000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11657:1876645426286080:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789708700.539220:0:11657:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14058760c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708700.543158:0:11657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f284000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11657:1876645426286080:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789708700.561230:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708700.561280:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415783168 00000100:00100000:0.0:1789708700.561290:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415783168 00000100:00100000:0.0:1789708700.561348:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00100000:0.0:1789708700.561358:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130852a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+51:10427:x1876645415783168:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1789708700.561379:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708700.561401:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c68665ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d48da expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.561468:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6866606 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.561483:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6866606 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.561521:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6866606 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.561538:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686660d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.561546:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686660d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.561552:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686660d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.578553:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c6866614 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.578575:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c6866614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.578681:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c6866614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708700.579960:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789708700.579967:0:11601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789708700.580168:0:11601:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c6866614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.580185:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c6866614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.580197:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6866606 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.580222:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6866606 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.580229:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6866606 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.580235:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a8400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708700.580239:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6866606 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.580247:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6866606 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.580273:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:0.0:1789708700.580277:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708700.580284:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6866606 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.580291:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6866606 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.580308:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686660d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.580314:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686660d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.580320:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686660d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.580325:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a9200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708700.580335:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686660d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.580341:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686660d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.580349:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a14148f3600) 00010000:00010000:0.0:1789708700.580352:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708700.580355:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686660d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.580361:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686660d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.580404:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c68665ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48da expref: 53 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.581933:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c6866614 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48da expref: 52 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.581952:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38e00) 00010000:00010000:0.0:1789708700.581955:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708700.581958:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14014a9c00, rc 0) 00000100:00100000:0.0:1789708700.583098:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130852a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+52:10427:x1876645415783168:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 21735us (21871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708700.583109:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00100000:0.0:1789708700.583235:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708700.586678:0:7625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415783296 00000100:00100000:0.0:1789708700.586692:0:7625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415783296 00000100:00100000:0.0:1789708700.589415:0:7625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:0.0:1789708700.589452:0:7625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130852aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:14bb7f14-3461-47f6-86c9-db3f545050ad+52:10429:x1876645415783296:12345-192.168.202.53@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789708700.589535:0:7625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130852aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:14bb7f14-3461-47f6-86c9-db3f545050ad+52:10429:x1876645415783296:12345-192.168.202.53@tcp:900:lhsmtool_posix.0 Request processed in 94us (6299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708700.589543:0:7625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:0.0:1789708700.602130:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708700.602305:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415783424 00000100:00100000:1.0:1789708700.602315:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415783424 00000100:00100000:1.0:1789708700.602380:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 67 00000100:00100000:1.0:1789708700.602391:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130852ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+52:10429:x1876645415783424:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789708700.602436:0:7140:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789708700.602569:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130852ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+52:10429:x1876645415783424:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 179us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708700.602577:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 67 00000100:00100000:0.0:1789708700.625395:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708700.625479:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415783552 00000100:00100000:2.0:1789708700.625490:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415783552 00000100:00100000:2.0:1789708700.625550:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 68 00000100:00100000:2.0:1789708700.625560:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+52:10429:x1876645415783552:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789708700.625633:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686661b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.625689:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686661b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.625703:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686661b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.625760:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866622 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.625769:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866622 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.625776:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866622 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.625811:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6866629 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.625820:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6866629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.625827:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6866629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708700.625865:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789708700.625869:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789708700.625883:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6866629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.625894:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686661b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.625900:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686661b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.625907:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686661b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.625912:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708700.625917:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686661b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.625924:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686661b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.625934:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1411b4a700) 00010000:00010000:2.0:1789708700.625945:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708700.625952:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686661b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.625958:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686661b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.625972:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866622 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.625990:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866622 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.625996:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866622 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.626001:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6be00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708700.626004:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866622 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.626011:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866622 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.626018:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8a1414c38800) 00010000:00010000:2.0:1789708700.626021:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708700.626024:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866622 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.626029:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866622 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.626043:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6866629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.626055:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6866629 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.626060:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6866629 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.626064:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6aa00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708700.626067:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6866629 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.626073:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6866629 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.626081:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38e00) 00010000:00010000:2.0:1789708700.626083:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708700.626087:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6866629 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.626092:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6866629 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708700.626161:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+52:10429:x1876645415783552:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 Request processed in 603us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708700.626170:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 68 00000001:00080000:0.0:1789708700.636400:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967347 is committed 00000001:00080000:0.0:1789708700.636445:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000004:00080000:0.0:1789708700.636474:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1789708700.636501:0:5841:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a1308387a80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789708700.636506:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a140a6ab100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a1308387c00 00000020:00080000:0.0:1789708700.636510:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a140a6ab900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a1403c38800 00000001:00080000:0.0:1789708700.636527:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000100:00100000:0.0:1789708700.636792:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f271f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426286208:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789708700.636861:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789708700.637431:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1789708700.637528:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789708700.637617:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708700.637728:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415783808 00000100:00100000:0.0:1789708700.637737:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415783808 00000100:00100000:0.0:1789708700.637794:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:0.0:1789708700.637804:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+11:10429:x1876645415783808:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708700.637822:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708700.637842:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866630 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d48e1 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708700.637990:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426286208 00000100:00100000:3.0:1789708700.637996:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426286208 00000100:00100000:3.0:1789708700.638036:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789708700.638044:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1876645426286208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789708700.638066:0:6672:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1789708700.638092:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aacc999, atime: 0x6aacc999, ctime: 0x6aacc999, blocks: 0xb 00010000:00010000:3.0:1789708700.638099:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d588101a/0xa8f741d1c6866637 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708700.638113:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=266s v=(0 0) 00010000:00010000:3.0:1789708700.638117:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708700.638122:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d588101a/0xa8f741d1c6866637 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708700.638137:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d588101a/0xa8f741d1c6866637 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708700.638147:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d588101a/0xa8f741d1c6866637 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708700.638155:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d588101a/0xa8f741d1c6866637 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708700.638178:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789708700.638634:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3288:x1876645426286208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 589us (1771us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789708700.638642:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789708700.638697:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789708700.638710:0:8434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708700.638717:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d588101a/0xa8f741d1c6866637 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708700.638726:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39c00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708700.638731:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d588101a/0xa8f741d1c6866637 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708700.638740:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d588101a/0xa8f741d1c6866637 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708700.638755:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d588101a/0xa8f741d1c6866637 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708700.638762:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d588101a/0xa8f741d1c6866637 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708700.638780:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708700.638782:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708700.638784:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789708700.638819:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a143f271f80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1789708700.638835:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f271f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426286208:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789708700.640185:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c686663e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.640216:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c686663e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.640227:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c686663e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708700.640240:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789708700.640400:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c686663e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.640407:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c686663e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.640413:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c686663e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.640418:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22a00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708700.640422:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c686663e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.640429:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c686663e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.640440:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38e00) 00010000:00010000:0.0:1789708700.640443:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708700.640447:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c686663e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.640453:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c686663e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.640500:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866630 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48e1 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.640517:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1411b4a700) 00010000:00010000:0.0:1789708700.640520:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789708700.640524:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866630 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48e1 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.640533:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d22600, rc 0) 00000100:00100000:0.0:1789708700.640598:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+12:10429:x1876645415783808:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 2795us (2982us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1789708700.640609:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:1.0:1789708700.704050:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708700.704166:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415783936 00000100:00100000:0.0:1789708700.704178:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415783936 00000100:00100000:0.0:1789708700.704269:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 70 00000100:00100000:0.0:1789708700.704281:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+12:10429:x1876645415783936:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789708700.704320:0:5821:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789708700.704474:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+12:10429:x1876645415783936:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 194us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708700.704490:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 70 00000100:00100000:3.0:1789708700.712084:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708700.713289:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415784192 00000100:00100000:0.0:1789708700.713303:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415784192 00000100:00100000:0.0:1789708700.713378:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 71 00000100:00100000:0.0:1789708700.713390:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+12:10429:x1876645415784192:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708700.713423:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708700.713426:0:11601:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789708700.713462:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c68665f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48d3 expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.713524:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:0.0:1789708700.713530:0:11601:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708700.713543:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c686664c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d48e8 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789708700.715141:0:11601:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789708700.715422:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5e00/0xa8f741d1c6866653 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708700.716543:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5e00/0xa8f741d1c6866653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708700.716556:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5e00/0xa8f741d1c6866653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708700.716908:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c686664c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48e8 expref: 14 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708700.716930:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5e00/0xa8f741d1c6866653 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48e8 expref: 13 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708700.716938:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a14033c4c00) 00010000:00010000:1.0:1789708700.716940:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708700.716944:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5e00, rc 0) 00000100:00100000:1.0:1789708700.717177:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+13:10429:x1876645415784192:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 3789us (5102us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789708700.717188:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 71 00000100:00100000:1.0:1789708700.744802:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708700.745043:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415784448 00000100:00100000:0.0:1789708700.745052:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415784448 00000100:00100000:0.0:1789708700.745121:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 72 00000100:00100000:0.0:1789708700.745131:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+13:10429:x1876645415784448:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789708700.745185:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708700.745211:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5e00/0xa8f741d1c6866653 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48e8 expref: 13 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.745228:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a14033c4c00) 00010000:00010000:0.0:1789708700.745238:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708700.745258:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866661 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.745283:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866661 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.745292:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866661 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.745307:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866668 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa84ecb5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.745315:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866668 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa84ecb5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.745337:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866668 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa84ecb5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.746050:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866661 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.746060:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866661 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.746067:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866661 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.746073:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708700.746078:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866661 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.746086:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866661 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.746096:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:0.0:1789708700.746099:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708700.746103:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866661 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.746109:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866661 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.746120:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866668 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa84ecb5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.746127:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866668 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa84ecb5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.746139:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866668 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa84ecb5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.746144:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708700.746146:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866668 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa84ecb5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.746152:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866668 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa84ecb5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.746161:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa84ecb5d (ffff8a14148f3600) 00010000:00010000:0.0:1789708700.746163:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708700.746166:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866668 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa84ecb5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.746173:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866668 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa84ecb5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708700.746280:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+12:10429:x1876645415784448:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 1148us (1485us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789708700.746288:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 72 00000100:00100000:0.0:1789708700.751505:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708700.751755:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415784576 00000100:00100000:2.0:1789708700.751766:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415784576 00000100:00100000:2.0:1789708700.751836:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 73 00000100:00100000:2.0:1789708700.751847:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+12:10429:x1876645415784576:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708700.751885:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708700.751909:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c686666f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d48ef expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.751946:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866676 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.751959:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.751970:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.752078:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c686666f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48ef expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.752095:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866676 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48ef expref: 13 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708700.752103:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:2.0:1789708700.752106:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789708700.752109:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6be00, rc 0) 00000100:00100000:2.0:1789708700.752179:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+13:10429:x1876645415784576:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 334us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708700.752185:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 73 00000100:00100000:3.0:1789708700.758275:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708700.758369:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415784832 00000100:00100000:1.0:1789708700.758379:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415784832 00000100:00100000:1.0:1789708700.758445:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 74 00000100:00100000:1.0:1789708700.758456:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+13:10429:x1876645415784832:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789708700.758545:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686667d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708700.758562:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686667d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708700.758597:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686667d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789708700.758923:0:11601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1789708700.758933:0:11601:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 266556282303ns, next at 267556279173ns, rc = 0 00000004:00010000:1.0:1789708700.759197:0:11601:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006df805f2 reply state 000000003dc6e941 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686667d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708700.759208:0:11601:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789708700.759415:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+15:10429:x1876645415784832:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 959us (1158us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1789708700.759423:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 74 00000100:00100000:3.0:1789708700.769840:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00010000:00010000:1.0:1789708700.769932:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686667d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708700.769946:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686667d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708700.769954:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686667d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708700.769961:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708700.769967:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686667d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708700.769986:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686667d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708700.770003:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:1.0:1789708700.770007:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789708700.770023:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686667d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708700.770030:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686667d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708700.770278:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415784960 00000100:00100000:0.0:1789708700.770288:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415784960 00000100:00100000:0.0:1789708700.770349:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 75 00000100:00100000:0.0:1789708700.770360:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+14:10429:x1876645415784960:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708700.770384:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708700.770400:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866684 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d48f6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.770947:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866684 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48f6 expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.770963:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866684 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48f6 expref: 15 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708700.770999:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:0.0:1789708700.771002:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708700.771005:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23e00, rc 0) 00000100:00100000:0.0:1789708700.771074:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+15:10429:x1876645415784960:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 715us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708700.771081:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 75 00000100:00100000:3.0:1789708700.776362:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708700.776907:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415785088 00000100:00100000:0.0:1789708700.776919:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415785088 00000100:00100000:0.0:1789708700.776970:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:0.0:1789708700.776989:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1876645415785088:12345-192.168.202.53@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1789708700.777023:0:10424:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:0.0:1789708700.777054:0:10424:0:(genops.c:1384:class_connect()) connect: client 14bb7f14-3461-47f6-86c9-db3f545050ad, cookie 0xa8f741d1c686668b 00002000:00100000:0.0:1789708700.777065:0:10424:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 14bb7f14-3461-47f6-86c9-db3f545050ad/ffff8a14059d2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789708700.777087:0:10424:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789708700.777331:0:10424:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789708700.777362:0:10424:0:(import.c:65:import_set_state_nolock()) ffff8a13069bd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708700.777841:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2360:x1876645415785088:12345-192.168.202.53@tcp:8:lhsmtool_posix.0 Request processed in 849us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708700.777866:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:1.0:1789708700.792829:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708700.793692:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415785216 00000100:00100000:3.0:1789708700.793704:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415785216 00000100:00100000:3.0:1789708700.793832:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 26 00000100:00100000:3.0:1789708700.793843:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:0:x1876645415785216:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789708700.794545:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789708700.794767:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708700.932411:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708700.932456:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708700.932517:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708700.932547:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415785472 00000100:00100000:3.0:1789708700.932556:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415785472 00000100:00100000:3.0:1789708700.932618:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:3.0:1789708700.932628:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2362:x1876645415785472:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708700.932719:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2362:x1876645415785472:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 91us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708700.932727:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00080000:2.0:1789708700.933884:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708700.933901:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415785600 00000100:00100000:2.0:1789708700.933908:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415785600 00000100:00100000:2.0:1789708700.937086:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 90 00000100:00100000:2.0:1789708700.937112:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c9d2a103-cf70-4470-bdd0-387470668318+5:2361:x1876645415785600:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708700.937190:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c9d2a103-cf70-4470-bdd0-387470668318+5:2361:x1876645415785600:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 85us (4672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708700.937197:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 90 00000100:00100000:2.0:1789708700.937228:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415785344 00000100:00100000:2.0:1789708700.937235:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415785344 00000100:00100000:2.0:1789708700.937265:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 267 00000100:00100000:2.0:1789708700.937272:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2361:x1876645415785344:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708700.937300:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2361:x1876645415785344:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 29us (4843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708700.937307:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 267 00000100:00080000:2.0:1789708700.937332:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708701.001998:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+7:0:x1876645415785216:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 208148us (209167us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789708701.002012:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 26 00000001:00100000:0.0:1789708701.002211:0:7627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14bb7f14-3461-47f6-86c9-db3f545050ad 00000001:00080000:0.0:1789708701.002225:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1789708701.010226:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708701.013035:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415785856 00000100:00100000:2.0:1789708701.013051:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415785856 00000100:00100000:2.0:1789708701.013122:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:2.0:1789708701.013134:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+15:10429:x1876645415785856:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789708701.013373:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+16:10429:x1876645415785856:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 241us (3154us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789708701.013382:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:1.0:1789708701.026836:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708701.027156:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415786112 00000100:00100000:0.0:1789708701.027166:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415786112 00000100:00100000:0.0:1789708701.027231:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 76 00000100:00100000:0.0:1789708701.027243:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+16:10429:x1876645415786112:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789708701.027353:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+16:10429:x1876645415786112:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 114us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708701.027362:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 76 00000100:00100000:2.0:1789708701.043140:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708701.043382:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415786240 00000100:00100000:3.0:1789708701.043404:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415786240 00000100:00100000:3.0:1789708701.043469:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 77 00000100:00100000:3.0:1789708701.043490:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+16:10429:x1876645415786240:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708701.043511:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708701.043529:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866692 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d48fd expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.043601:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866699 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.043616:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866699 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.043627:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866699 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708701.043680:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789708701.043699:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866699 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.043723:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866692 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48fd expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.043740:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866699 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48fd expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.043749:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:3.0:1789708701.043751:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789708701.043754:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39c00, rc 0) 00000100:00100000:3.0:1789708701.043817:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+17:10429:x1876645415786240:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 329us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708701.043835:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 77 00000100:00100000:1.0:1789708701.049309:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708701.049387:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415786368 00000100:00100000:3.0:1789708701.049408:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415786368 00000100:00100000:3.0:1789708701.049468:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:3.0:1789708701.049479:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2361:x1876645415786368:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708701.049499:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708701.049523:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce8ce270/0xa8f741d1c68666a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4904 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789708701.049549:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aacc99d, blocks: 0x1 00010000:00010000:3.0:1789708701.049570:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=266s v=(0 0) 00010000:00010000:3.0:1789708701.049575:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708701.049585:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce8ce270/0xa8f741d1c68666a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4904 expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.049606:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce8ce270/0xa8f741d1c68666a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4904 expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.049619:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38800, rc 0) 00000100:00100000:3.0:1789708701.049716:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415786368:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 238us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708701.049723:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:2.0:1789708701.065279:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708701.065926:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415786624 00000100:00100000:3.0:1789708701.065936:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415786624 00000100:00100000:3.0:1789708701.066060:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 78 00000100:00100000:3.0:1789708701.066072:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+17:10429:x1876645415786624:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789708701.066191:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+17:10429:x1876645415786624:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 120us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708701.066200:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 78 00000100:00100000:1.0:1789708701.070068:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708701.071146:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415786752 00000100:00100000:3.0:1789708701.071158:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415786752 00000100:00100000:3.0:1789708701.071226:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:3.0:1789708701.071237:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+6:10429:x1876645415786752:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708701.071256:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708701.071277:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e6df6df/0xa8f741d1c68666a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d490b expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.071309:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce8ce270/0xa8f741d1c68666a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4904 expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.071319:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708701.071323:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708701.071329:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e6df6df/0xa8f741d1c68666a7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d490b expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.071364:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce8ce270/0xa8f741d1c68666a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4904 expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.071378:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce8ce270/0xa8f741d1c68666a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4904 expref: 7 pid: 6673 timeout: 366 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708701.071391:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f286300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1876645426286336:192.168.202.53@tcp:104: 00000100:00100000:3.0:1789708701.071504:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789708701.076019:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f286300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1876645426286336:192.168.202.53@tcp:104: 00010000:00010000:3.0:1789708701.076052:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006e6df6df/0xa8f741d1c68666a7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d490b expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.076075:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38c00, rc 0) 00000100:00100000:3.0:1789708701.076133:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+7:10429:x1876645415786752:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 4898us (6087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708701.076142:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:2.0:1789708701.090079:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708701.090901:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415786880 00000100:00100000:3.0:1789708701.090911:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415786880 00010000:00010000:3.0:1789708701.090951:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce8ce270/0xa8f741d1c68666a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4904 expref: 7 pid: 6673 timeout: 366 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708701.091005:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:3.0:1789708701.091014:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1407f54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2362:x1876645415786880:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708701.091030:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708701.091051:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce8ce270/0xa8f741d1c68666a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4904 expref: 7 pid: 6673 timeout: 366 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.091065:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce8ce270/0xa8f741d1c68666a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4904 expref: 7 pid: 6673 timeout: 366 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.091099:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce8ce270/0xa8f741d1c68666a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4904 expref: 7 pid: 6673 timeout: 366 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.091133:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708701.091138:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708701.091147:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006e6df6df/0xa8f741d1c68666a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d490b expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.091157:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e6df6df/0xa8f741d1c68666a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d490b expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.091194:0:5805:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006e6df6df/0xa8f741d1c68666a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d490b expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708701.091219:0:5805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f286300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5805:1876645426286464:192.168.202.53@tcp:105: 00000100:00100000:3.0:1789708701.091303:0:5805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1414e4b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789708701.100746:0:5805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f286300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5805:1876645426286464:192.168.202.53@tcp:105: 00010000:00010000:3.0:1789708701.100770:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708701.100822:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1407f54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2362:x1876645415786880:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 9809us (10753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708701.100834:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:2.0:1789708701.101767:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708701.101822:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415787008 00000100:00100000:0.0:1789708701.101831:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415787008 00002000:00100000:0.0:1789708701.101875:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8a143fb2a680 x1876645415787008/t0(0) o4->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:87/0 lens 504/0 e 0 to 0 dl 1789708712 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789708701.101886:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a143fb2a680 with x1876645415787008 ext(0->8) 00002000:00010000:0.0:1789708701.101890:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a143fb2a680 00000100:00100000:0.0:1789708701.101919:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:0.0:1789708701.101927:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415787008:12345-192.168.202.53@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789708701.102514:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2361:x1876645415787008:12345-192.168.202.53@tcp:4:lhsmtool_posix.0 Request processed in 585us (747us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789708701.102522:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00002000:00100000:0.0:1789708701.102530:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8a143fb2a680 x1876645415787008/t4294967302(0) o4->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:87/0 lens 504/448 e 0 to 0 dl 1789708712 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789708701.102539:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a143fb2a680 with x1876645415787008 ext(0->8) 00002000:00010000:0.0:1789708701.102548:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a143fb2a680 00000100:00100000:2.0:1789708701.109025:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708701.109102:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415787136 00000100:00100000:0.0:1789708701.109112:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415787136 00000100:00100000:0.0:1789708701.109212:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 79 00000100:00100000:0.0:1789708701.109224:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+17:10429:x1876645415787136:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789708701.201967:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:1.0:1789708701.201997:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1789708701.202001:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789708701.202015:0:5841:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1789708701.202024:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1789708701.202034:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1789708701.202043:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789708701.202183:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+13:10429:x1876645415787136:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 Request processed in 92956us (93160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708701.202194:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 79 00000100:00100000:3.0:1789708701.206985:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426286592:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789708701.207068:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708701.207216:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426286592 00000100:00100000:0.0:1789708701.207225:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426286592 00000100:00100000:0.0:1789708701.207289:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789708701.207303:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426286592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789708701.207507:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789708701.207512:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789708701 00002000:00010000:0.0:1789708701.207514:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789708701.207517:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789708701 -> 1789708701 00002000:00010000:0.0:1789708701.207519:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789708701.207568:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3289:x1876645426286592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 269us (498us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789708701.207576:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789708701.207774:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789708701.215047:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a143f512300/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789708701.215065:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426286592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789708701.222179:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708701.222373:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415787264 00000100:00100000:0.0:1789708701.222385:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415787264 00000100:00100000:0.0:1789708701.222452:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:0.0:1789708701.222463:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2361:x1876645415787264:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789708701.315961:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1789708701.315985:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1789708701.316289:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415787264:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 Request processed in 93822us (94114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708701.316302:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:2.0:1789708701.320291:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708701.320769:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415787520 00000100:00100000:0.0:1789708701.320781:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415787520 00000100:00100000:0.0:1789708701.320931:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 80 00000100:00100000:0.0:1789708701.320943:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+13:10429:x1876645415787520:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789708701.321008:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708701.321037:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866699 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48fd expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708701.321052:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:0.0:1789708701.321057:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708701.321097:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c68666ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708701.321111:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c68666ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708701.321120:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c68666ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708701.321567:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043aaa9ab reply state 00000000dc6f261b transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c68666ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708701.321577:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789708701.321708:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+14:10429:x1876645415787520:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 766us (1426us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789708701.321716:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 80 00010000:00010000:3.0:1789708701.324731:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c68666ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.324746:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c68666ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.324766:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c68666ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.324772:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708701.324777:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c68666ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.324785:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c68666ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.324801:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:3.0:1789708701.324804:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708701.324808:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c68666ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.324814:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c68666ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708701.325917:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708701.325952:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415787648 00000100:00100000:3.0:1789708701.325961:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415787648 00000100:00100000:3.0:1789708701.326020:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:3.0:1789708701.326030:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2363:x1876645415787648:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789708701.326290:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789708701.326294:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789708701 -> 1789708700 00002000:00010000:3.0:1789708701.326296:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789708697 00002000:00010000:3.0:1789708701.326298:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789708701 -> 1789708700 00002000:00010000:3.0:1789708701.326300:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789708701.326357:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2363:x1876645415787648:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 328us (445us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789708701.326374:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:3.0:1789708701.332021:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708701.332062:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415787904 00000100:00100000:3.0:1789708701.332072:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415787904 00000100:00100000:3.0:1789708701.332126:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 81 00000100:00100000:3.0:1789708701.332137:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+13:10429:x1876645415787904:12345-192.168.202.53@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789708701.332206:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68666b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.332224:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866676 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48ef expref: 13 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.332234:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68666b5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.332269:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866676 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48ef expref: 13 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.332282:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866676 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48ef expref: 13 pid: 5820 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708701.332295:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f271180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1876645426286720:192.168.202.53@tcp:104: 00000100:00100000:3.0:1789708701.332385:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1302c296c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708701.352447:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708701.352793:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f271180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1876645426286720:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708701.352821:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68666b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708701.353136:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415788032 00000100:00100000:0.0:1789708701.353143:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415788032 00010000:00010000:0.0:1789708701.353183:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866676 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48ef expref: 14 pid: 5820 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708701.353247:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:0.0:1789708701.353257:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+14:2362:x1876645415788032:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708701.353271:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708701.353278:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866676 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48ef expref: 14 pid: 5820 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708701.353289:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866676 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48ef expref: 14 pid: 5820 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708701.353308:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866676 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48ef expref: 14 pid: 5820 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708701.353321:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:0.0:1789708701.353326:0:8435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68666b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708701.353334:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68666b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708701.353341:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68666b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708701.353358:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708701.353419:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+13:2362:x1876645415788032:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 164us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708701.353427:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 43 00010000:00010000:2.0:1789708701.353669:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68666b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.353677:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68666b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.353703:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68666b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.353709:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68666b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.353715:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68666b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.353721:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708701.353725:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68666b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.353732:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68666b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.353740:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:2.0:1789708701.353742:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789708701.353752:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68666b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.353758:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68666b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708701.353793:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+13:10429:x1876645415787904:12345-192.168.202.53@tcp:55:lhsmtool_posix.0 Request processed in 21659us (21783us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789708701.353801:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 81 00000100:00100000:0.0:1789708701.373148:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708701.378259:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415788160 00000100:00100000:1.0:1789708701.378275:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415788160 00000100:00100000:1.0:1789708701.378338:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:1.0:1789708701.378347:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2364:x1876645415788160:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789708701.378393:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c68666bc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708701.378426:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006e6df6df/0xa8f741d1c68666a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d490b expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708701.378435:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789708701.378439:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708701.378443:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c68666bc lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708701.378479:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006e6df6df/0xa8f741d1c68666a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d490b expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708701.378493:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006e6df6df/0xa8f741d1c68666a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d490b expref: 7 pid: 6670 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708701.378507:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434b94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1876645426286848:192.168.202.53@tcp:104: 00000100:00100000:1.0:1789708701.378596:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140319f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789708701.389677:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708701.389772:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415788288 00000100:00100000:3.0:1789708701.389783:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415788288 00010000:00010000:3.0:1789708701.389821:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006e6df6df/0xa8f741d1c68666a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d490b expref: 8 pid: 6670 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708701.391491:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:3.0:1789708701.391520:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2362:x1876645415788288:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708701.391539:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708701.391565:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006e6df6df/0xa8f741d1c68666a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d490b expref: 8 pid: 6670 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.391583:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006e6df6df/0xa8f741d1c68666a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d490b expref: 8 pid: 6670 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.391614:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789708701.391618:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789708701.391624:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c68666bc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.391633:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c68666bc lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.391670:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708701.392024:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2362:x1876645415788288:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 513us (2372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708701.392033:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 44 00010000:00010000:2.0:1789708701.392379:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e6df6df/0xa8f741d1c68666a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d490b expref: 7 pid: 6670 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708701.392409:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434b94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1876645426286848:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708701.392435:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c68666bc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.392444:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c68666bc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.392451:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c68666bc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.392474:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c68666bc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.392482:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c68666bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.392504:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c68666bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.392511:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4c00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:2.0:1789708701.392514:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c68666bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.392523:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c68666bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.392538:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c68666bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.392547:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c68666bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708701.392599:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2364:x1876645415788160:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 Request processed in 14253us (19459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708701.392607:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:0.0:1789708701.399313:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708701.400915:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415788544 00000100:00100000:3.0:1789708701.400928:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415788544 00000100:00100000:3.0:1789708701.401001:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 82 00000100:00100000:3.0:1789708701.401335:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+12:10429:x1876645415788544:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789708701.401444:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c68666c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.401460:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c68666c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.401471:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c68666c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.401712:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68666ca lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.401725:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866684 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48f6 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.401733:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68666ca lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.401769:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866684 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48f6 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.401783:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866684 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48f6 expref: 13 pid: 5819 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708701.401797:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143efa1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1876645426286976:192.168.202.53@tcp:104: 00000100:00100000:3.0:1789708701.401886:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1302c29d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708701.408867:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143efa1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1876645426286976:192.168.202.53@tcp:104: 00010000:00010000:3.0:1789708701.408901:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68666ca lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708701.414611:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708701.414932:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415788672 00000100:00100000:2.0:1789708701.414943:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415788672 00010000:00010000:2.0:1789708701.414998:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866684 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48f6 expref: 14 pid: 5819 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708701.415046:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:2.0:1789708701.415068:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+14:2361:x1876645415788672:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708701.415163:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708701.415172:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866684 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48f6 expref: 14 pid: 5819 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.415186:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866684 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48f6 expref: 14 pid: 5819 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.415220:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866684 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48f6 expref: 14 pid: 5819 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.415238:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:2.0:1789708701.415244:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68666ca lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.415254:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68666ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.415261:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68666ca lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.415296:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708701.415351:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+13:2361:x1876645415788672:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 284us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708701.415359:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 45 00010000:00010000:2.0:1789708701.415584:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68666ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.415593:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68666ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789708701.416251:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1789708701.417627:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1789708701.419626:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1789708701.419795:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f511180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5820:1876645426287104:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789708701.419873:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708701.419914:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708701.420800:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426287104 00000100:00100000:3.0:1789708701.420811:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426287104 00000100:00100000:3.0:1789708701.420863:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708701.420872:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5820:x1876645426287104:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789708701.420965:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5820:x1876645426287104:12345-0@lo:1000:mdt00_001.0 Request processed in 93us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708701.420981:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789708701.422250:0:5820:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1789708701.422259:0:5820:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a143f512300, transno 4294967303 00000100:00100000:2.0:1789708701.422323:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f511180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5820:1876645426287104:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789708701.437200:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1789708701.437329:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5820:1876645426287232:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789708701.440739:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708701.440910:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789708701.458497:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426287232 00000100:00100000:3.0:1789708701.458510:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426287232 00000100:00100000:1.0:1789708701.469829:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789708701.469843:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5820:x1876645426287232:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789708701.471624:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5820:x1876645426287232:12345-0@lo:1000:mdt00_001.0 Request processed in 1778us (30885us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789708701.471638:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789708701.480669:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5820:1876645426287232:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789708701.481760:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68666ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.481775:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68666ca lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.481784:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68666ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.481790:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708701.481795:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68666ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.481804:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68666ca lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.481819:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:3.0:1789708701.481823:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789708701.481827:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68666ca lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.481849:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68666ca lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.481889:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.481896:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665f8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.481901:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.481906:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6ba00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708701.481921:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.481928:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665f8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.481936:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38e00) 00010000:00010000:3.0:1789708701.481939:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789708701.481942:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665f8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.481947:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68665f8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.482004:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68666d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.482019:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c6866614 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48da expref: 16 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.482038:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68666d1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.482079:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c6866614 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48da expref: 16 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.482094:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c6866614 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48da expref: 16 pid: 11601 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708701.482108:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143efa1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1876645426287360:192.168.202.53@tcp:104: 00000100:00100000:3.0:1789708701.482749:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1302c296c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708701.494040:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708701.494171:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415788800 00000100:00100000:2.0:1789708701.494181:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415788800 00010000:00010000:2.0:1789708701.494232:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c6866614 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48da expref: 17 pid: 11601 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708701.494266:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:2.0:1789708701.494276:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+17:2361:x1876645415788800:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708701.494290:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708701.494297:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c6866614 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48da expref: 17 pid: 11601 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.494311:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c6866614 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48da expref: 17 pid: 11601 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.494349:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38e00) 00010000:00010000:2.0:1789708701.494354:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68666d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.494364:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68666d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.494372:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68666d1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.494391:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708701.494440:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+17:2361:x1876645415788800:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 165us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708701.494448:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 46 00010000:00010000:3.0:1789708701.494698:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c6866614 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d48da expref: 16 pid: 11601 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708701.494732:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143efa1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1876645426287360:192.168.202.53@tcp:104: 00010000:00010000:3.0:1789708701.494753:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68666d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.494763:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68666d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.494770:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68666d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.494783:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68666d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.494789:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68666d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.494803:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68666d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.494810:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708701.494814:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68666d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.494823:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68666d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.494833:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38e00) 00010000:00010000:3.0:1789708701.494836:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708701.494839:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68666d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.494845:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68666d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.494856:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c68666c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.494862:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c68666c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.494868:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c68666c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.494873:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708701.494876:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c68666c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.494892:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c68666c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.494900:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38e00) 00010000:00010000:3.0:1789708701.494902:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789708701.494906:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c68666c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.494912:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c68666c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708701.497539:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+15:10429:x1876645415788544:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 96199us (98226us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1789708701.497553:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 82 00000020:00080000:2.0:1789708701.497559:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789708701.497810:0:11657:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789708701.497820:0:11657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708701.497865:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789708701.497878:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789708701.513518:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708701.513589:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415789056 00000100:00100000:2.0:1789708701.513600:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415789056 00000100:00100000:2.0:1789708701.513709:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:2.0:1789708701.513721:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+15:10429:x1876645415789056:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789708701.514425:0:5823:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789708701.514534:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1789708701.514578:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68666d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.514594:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68666d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.514616:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68666d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.514625:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68666d8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.514633:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68666d8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.514639:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68666d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708701.514684:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789708701.514778:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+17:10429:x1876645415789056:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 1058us (1270us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789708701.514787:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00000020:00080000:2.0:1789708701.514792:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789708701.515151:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708701.515159:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68666d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.515167:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b600 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708701.515172:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68666d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.515181:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68666d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.515194:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:3.0:1789708701.515197:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789708701.515215:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68666d8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.515221:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68666d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708701.515239:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708701.515248:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708701.515250:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708701.819682:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708701.947378:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143efa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426287488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708701.947478:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708701.947558:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426287488 00000100:00100000:3.0:1789708701.947567:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426287488 00000100:00100000:3.0:1789708701.947623:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789708701.947632:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1876645426287488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789708701.947689:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708701.947735:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1876645426287488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708701.947743:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789708701.947790:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143efa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426287488:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789708701.957539:0:11978:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789708701.957862:0:11978:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789708701.957924:0:11978:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789708701.957940:0:11978:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789708702.279205:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708702.282780:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415789312 00000100:00100000:2.0:1789708702.282798:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415789312 00000100:00100000:2.0:1789708702.282878:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 83 00000100:00100000:2.0:1789708702.282891:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+17:10449:x1876645415789312:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708702.282916:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708702.282937:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68666df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4912 expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.283053:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68666e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.283081:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68666e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.283105:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68666e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708702.283118:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789708702.283253:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68666df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4912 expref: 20 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.283271:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68666e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4912 expref: 19 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.283279:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:2.0:1789708702.283282:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789708702.283286:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6aa00, rc 0) 00000100:00100000:2.0:1789708702.283352:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+19:10449:x1876645415789312:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 465us (4167us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1789708702.283361:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 83 00000100:00080000:0.0:1789708702.283916:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708702.292535:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708702.292693:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415789440 00000100:00100000:1.0:1789708702.292712:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415789440 00000100:00100000:1.0:1789708702.292769:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 84 00000100:00100000:1.0:1789708702.292779:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+19:10449:x1876645415789440:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:1.0:1789708702.292856:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c68666f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.292874:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c68666f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.292886:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c68666f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.292903:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68666fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.292911:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68666fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.292917:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68666fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293431:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866702 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293442:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293462:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708702.293500:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293513:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c68666f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293521:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c68666f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293527:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c68666f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293533:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708702.293536:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c68666f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293543:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c68666f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293553:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:1.0:1789708702.293557:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708702.293561:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c68666f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293567:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c68666f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293576:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68666fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293589:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68666fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293594:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68666fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293598:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708702.293601:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68666fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293607:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68666fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293613:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a14033c4200) 00010000:00010000:1.0:1789708702.293615:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708702.293618:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68666fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293623:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68666fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293636:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293642:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866702 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293647:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866702 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293676:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5a00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708702.293684:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866702 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293690:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866702 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293697:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a14033c4000) 00010000:00010000:1.0:1789708702.293710:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708702.293714:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866702 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.293720:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866702 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708702.293802:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+19:10449:x1876645415789440:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 1023us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708702.293811:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 84 00000100:00100000:0.0:1789708702.381422:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708702.381636:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415789696 00000100:00100000:2.0:1789708702.381833:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415789696 00000100:00100000:2.0:1789708702.381929:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 85 00000100:00100000:2.0:1789708702.381941:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+19:10452:x1876645415789696:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708702.381973:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708702.381996:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866709 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4919 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382096:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866710 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382111:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866710 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382123:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866710 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382140:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866717 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382148:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382155:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382531:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c686671e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382541:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c686671e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382549:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c686671e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708702.382560:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789708702.382671:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866710 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382679:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866710 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382789:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866710 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382796:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708702.382801:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866710 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382810:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866710 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382823:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:2.0:1789708702.382826:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708702.382831:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866710 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382837:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866710 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382849:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382855:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866717 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382861:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866717 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382866:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6ac00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708702.382869:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866717 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382885:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866717 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382892:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1414c38600) 00010000:00010000:2.0:1789708702.382895:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708702.382898:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866717 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382904:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866717 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382943:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866709 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4919 expref: 22 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382968:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c686671e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4919 expref: 21 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.382976:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38500) 00010000:00010000:2.0:1789708702.382978:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708702.382980:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6ba00, rc 0) 00000100:00100000:2.0:1789708702.383055:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+21:10452:x1876645415789696:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1116us (2044us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789708702.383064:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 85 00000100:00100000:1.0:1789708702.394284:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708702.394416:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415789824 00000100:00100000:2.0:1789708702.394478:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415789824 00000100:00100000:2.0:1789708702.394553:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 86 00000100:00100000:2.0:1789708702.394562:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+21:10452:x1876645415789824:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:2.0:1789708702.394635:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686672c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.394669:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686672c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.394679:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686672c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.394703:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686672c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.394708:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686672c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.394712:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686672c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.394715:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708702.394719:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686672c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.394724:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686672c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.394731:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38500) 00010000:00010000:2.0:1789708702.394733:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789708702.394737:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686672c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.394741:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686672c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708702.394809:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+21:10452:x1876645415789824:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 248us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708702.394815:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 86 00000100:00100000:3.0:1789708702.398804:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708702.400102:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415790080 00000100:00100000:2.0:1789708702.400116:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415790080 00000100:00100000:2.0:1789708702.400183:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:2.0:1789708702.400207:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14069f9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+21:10452:x1876645415790080:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1789708702.400461:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14069f9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+22:10452:x1876645415790080:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 256us (1666us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1789708702.400469:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:0.0:1789708702.449176:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708702.449323:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415790336 00000100:00100000:2.0:1789708702.449334:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415790336 00000100:00100000:2.0:1789708702.449441:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 87 00000100:00100000:2.0:1789708702.449453:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a141080a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+22:9979:x1876645415790336:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1789708702.449479:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708702.449501:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866733 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4920 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.449609:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686673a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.449624:0:11601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c686671e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4919 expref: 23 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.449633:0:11601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686673a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.449836:0:11601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c686671e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4919 expref: 23 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.449851:0:11601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c686671e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4919 expref: 23 pid: 5820 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708702.449866:0:11601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1435cc7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11601:1876645426287616:192.168.202.53@tcp:104: 00000100:00100000:2.0:1789708702.449951:0:11601:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307f180 going to sleep for 11 seconds 00000100:00100000:1.0:1789708702.453063:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708702.453190:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415790464 00000100:00100000:3.0:1789708702.453210:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415790464 00010000:00010000:3.0:1789708702.453252:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c686671e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4919 expref: 24 pid: 5820 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708702.453295:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:3.0:1789708702.453306:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+24:2362:x1876645415790464:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708702.453322:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708702.453329:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c686671e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4919 expref: 24 pid: 5820 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.453341:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c686671e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4919 expref: 24 pid: 5820 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.453379:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38500) 00010000:00010000:3.0:1789708702.453384:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686673a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.453393:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686673a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.453402:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686673a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.453426:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708702.453480:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+24:2362:x1876645415790464:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 175us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708702.453487:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 47 00010000:00010000:2.0:1789708702.453628:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c686671e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4919 expref: 23 pid: 5820 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708702.453645:0:11601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1435cc7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11601:1876645426287616:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708702.453700:0:11601:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686673a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.453709:0:11601:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686673a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.453715:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686673a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708702.453735:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789708702.453881:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866733 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4920 expref: 24 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.453896:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686673a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4920 expref: 23 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.453917:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38500) 00010000:00010000:2.0:1789708702.453919:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789708702.453922:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6be00, rc 0) 00000100:00100000:2.0:1789708702.453951:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a141080a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+23:9979:x1876645415790336:12345-192.168.202.53@tcp:101:bash.0 Request processed in 4501us (4785us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789708702.453971:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 87 00000100:00100000:3.0:1789708702.458473:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708702.458600:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415790720 00000100:00100000:2.0:1789708702.458611:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415790720 00000100:00100000:2.0:1789708702.458703:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 88 00000100:00100000:2.0:1789708702.458715:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+23:9979:x1876645415790720:12345-192.168.202.53@tcp:36:bash.0 00010000:00010000:2.0:1789708702.458993:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866748 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.459011:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.459024:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789708702.459082:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1789708702.459117:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007823304c reply state 000000007f038efa transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708702.459126:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789708702.459175:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1789708702.459281:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+27:9979:x1876645415790720:12345-192.168.202.53@tcp:36:bash.0 Request processed in 566us (816us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789708702.459289:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 88 00000020:00080000:2.0:1789708702.459306:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789708702.460048:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f53d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426288128:0@lo:400:kworker.0 00000100:00100000:1.0:1789708702.460103:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708702.460145:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789708702.460151:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143efa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426287744:0@lo:400:kworker.0 00000100:00100000:1.0:1789708702.460180:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708702.460208:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f53f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876645426288256:0@lo:400:kworker.0 00000100:00100000:1.0:1789708702.460233:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708702.460258:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426287744 00000100:00100000:1.0:1789708702.460264:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426287744 00000100:00100000:1.0:1789708702.460296:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789708702.460311:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3286:x1876645426287744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708702.460354:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3286:x1876645426287744:12345-0@lo:400:kworker.0 Request processed in 45us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708702.460362:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789708702.460403:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143efa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426287744:0@lo:400:kworker.0 00000100:00100000:2.0:1789708702.460623:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143ec30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426287872:0@lo:400:kworker.0 00000100:00100000:3.0:1789708702.460727:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426288128 00000100:00100000:3.0:1789708702.460732:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426288128 00000100:00100000:3.0:1789708702.460832:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789708702.460840:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3286:x1876645426288128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708702.460881:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3286:x1876645426288128:12345-0@lo:400:kworker.0 Request processed in 43us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708702.460888:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789708702.460954:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708702.461696:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f53d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426288128:0@lo:400:kworker.0 00000100:00100000:2.0:1789708702.461896:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708702.462017:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f53dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426288384:0@lo:400:kworker.0 00000100:00100000:2.0:1789708702.462054:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708702.462086:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789708702.462093:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f53d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426288000:0@lo:400:kworker.0 00000100:00100000:2.0:1789708702.462116:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708702.462545:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426288384 00000100:00100000:1.0:1789708702.462554:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426288384 00000100:00100000:1.0:1789708702.462595:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789708702.462603:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1876645426288384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708702.462671:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1876645426288384:12345-0@lo:400:kworker.0 Request processed in 46us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708702.462677:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1789708702.465242:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.465259:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866748 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.465267:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866748 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.465277:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6ac00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708702.465284:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866748 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.465294:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866748 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.465326:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38500) 00010000:00010000:1.0:1789708702.465328:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708702.465333:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866748 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.465339:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866748 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708702.466006:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143efa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426288512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708702.466069:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708702.466294:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f53dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426288384:0@lo:400:kworker.0 00000100:00100000:2.0:1789708702.466333:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426288512 00000100:00100000:2.0:1789708702.466339:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426288512 00000100:00100000:2.0:1789708702.466382:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789708702.466389:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1876645426288512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789708702.466486:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789708702.466527:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1876645426288512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708702.466533:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789708702.466563:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708702.466740:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426288256 00000100:00100000:0.0:1789708702.466745:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426288256 00000100:00100000:3.0:1789708702.466893:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426287872 00000100:00100000:3.0:1789708702.466898:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426287872 00000100:00100000:3.0:1789708702.466934:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426288000 00000100:00100000:3.0:1789708702.466937:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426288000 00000100:00100000:3.0:1789708702.466972:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789708702.466978:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426287872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708702.467029:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426287872:12345-0@lo:400:kworker.0 Request processed in 51us (5133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708702.467035:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789708702.467047:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789708702.467052:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426288000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708702.467073:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426288000:12345-0@lo:400:kworker.0 Request processed in 22us (4957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708702.467077:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1789708702.467121:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708702.467589:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f53d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426288000:0@lo:400:kworker.0 00000100:00100000:2.0:1789708702.467605:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143efa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426288512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708702.467614:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143ec30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426287872:0@lo:400:kworker.0 00000100:00100000:0.0:1789708702.467679:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415790848 00000100:00100000:0.0:1789708702.467683:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415790848 00000100:00100000:0.0:1789708702.467763:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 89 00000100:00100000:0.0:1789708702.467772:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+26:9979:x1876645415790848:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1789708702.467789:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708702.467808:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c686674f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4927 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.467865:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c686674f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4927 expref: 27 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.467880:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c686674f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4927 expref: 27 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.467900:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38500) 00010000:00010000:0.0:1789708702.467917:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708702.467921:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23800, rc 0) 00000100:00100000:0.0:1789708702.467984:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+27:9979:x1876645415790848:12345-192.168.202.53@tcp:101:bash.0 Request processed in 214us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708702.467990:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 89 00000100:00100000:2.0:1789708702.469977:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789708702.470003:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876645426288256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708702.470085:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876645426288256:12345-0@lo:400:kworker.0 Request processed in 85us (9851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708702.470092:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1789708702.470147:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708702.470497:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f53f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876645426288256:0@lo:400:kworker.0 00000100:00100000:3.0:1789708702.471073:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708702.471321:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415790976 00000100:00100000:0.0:1789708702.471328:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415790976 00000100:00100000:0.0:1789708702.471381:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:0.0:1789708702.471392:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+6:9979:x1876645415790976:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1789708702.471405:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1789708702.471489:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789708702.471537:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c6866756 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d492e expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708702.471562:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aacc99c, atime: 0x6aacc999, ctime: 0x6aacc99c, blocks: 0xb 00010000:00010000:0.0:1789708702.471580:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1789708702.471584:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708702.471591:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c6866756 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d492e expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.471606:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c6866756 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d492e expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.471617:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d22c00, rc 0) 00000100:00100000:0.0:1789708702.471681:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+7:9979:x1876645415790976:12345-192.168.202.53@tcp:101:bash.0 Request processed in 293us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708702.471687:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:2.0:1789708702.473746:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708702.473828:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415791104 00000100:00100000:3.0:1789708702.473841:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415791104 00002000:00010000:3.0:1789708702.473884:0:6676:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1789708702.473888:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1435cc6680 with x1876645415791104 ext(0->18446744073709551615) 00002000:00010000:3.0:1789708702.473899:0:6676:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1435cc6680. 00000100:00100000:3.0:1789708702.473929:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:3.0:1789708702.473937:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2364:x1876645415791104:12345-192.168.202.53@tcp:10:bash.0 00002000:00010000:3.0:1789708702.474210:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789708702.474214:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789708700 -> 1789708702 00002000:00010000:3.0:1789708702.474216:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789708697 -> 1789708697 00002000:00010000:3.0:1789708702.474218:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789708700 -> 1789708702 00002000:00010000:3.0:1789708702.474220:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789708702.474280:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2364:x1876645415791104:12345-192.168.202.53@tcp:10:bash.0 Request processed in 340us (539us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789708702.474288:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 1 00002000:00010000:3.0:1789708702.474304:0:6676:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1789708702.474309:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1435cc6680 with x1876645415791104 ext(0->18446744073709551615) 00002000:00010000:3.0:1789708702.474314:0:6676:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1435cc6680. 00000100:00100000:1.0:1789708702.545638:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708702.545772:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415791232 00000100:00100000:0.0:1789708702.545783:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415791232 00000100:00100000:0.0:1789708702.545841:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 90 00000100:00100000:0.0:1789708702.545852:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143efa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+27:10466:x1876645415791232:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:0.0:1789708702.545937:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686675d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.545953:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686675d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.545975:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686675d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.545991:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22400/0xa8f741d1c6866764 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.545997:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22400/0xa8f741d1c6866764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546003:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22400/0xa8f741d1c6866764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546242:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23400/0xa8f741d1c686676b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546251:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23400/0xa8f741d1c686676b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546258:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23400/0xa8f741d1c686676b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708702.546296:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23400/0xa8f741d1c686676b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546314:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686675d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546321:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686675d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546328:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686675d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546334:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23a00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708702.546343:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686675d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546352:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686675d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546367:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:0.0:1789708702.546369:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708702.546376:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686675d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546381:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686675d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546392:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22400/0xa8f741d1c6866764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546398:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22400/0xa8f741d1c6866764 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546403:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22400/0xa8f741d1c6866764 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546414:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708702.546417:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22400/0xa8f741d1c6866764 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546422:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22400/0xa8f741d1c6866764 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546429:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a14148f3c00) 00010000:00010000:0.0:1789708702.546431:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708702.546434:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22400/0xa8f741d1c6866764 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546439:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22400/0xa8f741d1c6866764 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546452:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23400/0xa8f741d1c686676b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546457:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23400/0xa8f741d1c686676b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546463:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23400/0xa8f741d1c686676b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546467:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708702.546470:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23400/0xa8f741d1c686676b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546478:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23400/0xa8f741d1c686676b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546492:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38500) 00010000:00010000:0.0:1789708702.546494:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708702.546497:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23400/0xa8f741d1c686676b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.546502:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23400/0xa8f741d1c686676b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708702.546577:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143efa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+27:10466:x1876645415791232:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 727us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708702.546585:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 90 00000100:00100000:1.0:1789708702.581181:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708702.581341:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415791488 00000100:00100000:2.0:1789708702.581354:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415791488 00000100:00100000:2.0:1789708702.581415:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 91 00000100:00100000:2.0:1789708702.581432:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+27:10469:x1876645415791488:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708702.581453:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708702.581473:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866772 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4935 expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.581539:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866779 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.581552:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866779 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.581563:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866779 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.581577:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866780 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.581583:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.581589:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582113:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866787 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582124:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866787 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582132:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866787 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708702.582141:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789708702.582236:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866779 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582244:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866779 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582250:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866779 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582256:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708702.582260:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866779 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582266:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866779 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582277:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:3.0:1789708702.582280:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708702.582283:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866779 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582294:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866779 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582306:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582311:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866780 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582316:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582321:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6bc00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708702.582323:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582328:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866780 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582334:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1414c38600) 00010000:00010000:3.0:1789708702.582336:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708702.582338:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866780 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582342:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866780 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582378:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866772 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4935 expref: 30 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582394:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866787 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4935 expref: 29 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.582408:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38500) 00010000:00010000:3.0:1789708702.582410:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789708702.582413:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38600, rc 0) 00000100:00100000:3.0:1789708702.582489:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+29:10469:x1876645415791488:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1065us (1320us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1789708702.582498:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 91 00000100:00100000:3.0:1789708702.585412:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708702.585628:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415791616 00000100:00100000:1.0:1789708702.585638:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415791616 00000100:00100000:1.0:1789708702.585732:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 92 00000100:00100000:1.0:1789708702.585742:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+29:10469:x1876645415791616:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:1.0:1789708702.585807:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866795 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.585838:0:11601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686673a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4920 expref: 29 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.585849:0:11601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866795 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.585883:0:11601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686673a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4920 expref: 29 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.585895:0:11601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686673a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4920 expref: 29 pid: 11601 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708702.585925:0:11601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1426d08380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11601:1876645426288640:192.168.202.53@tcp:104: 00000100:00100000:1.0:1789708702.586010:0:11601:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140319f480 going to sleep for 11 seconds 00000100:00100000:1.0:1789708702.589286:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708702.589377:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415791872 00000100:00100000:3.0:1789708702.589386:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415791872 00000100:00100000:3.0:1789708702.589445:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:3.0:1789708702.589454:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+30:5592:x1876645415791872:12345-192.168.202.53@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789708702.589789:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+31:5592:x1876645415791872:12345-192.168.202.53@tcp:35:ldlm_bl.0 Request processed in 334us (510us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789708702.589797:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:2.0:1789708702.590230:0:11601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1426d08380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11601:1876645426288640:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708702.590253:0:11601:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866795 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708702.591915:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708702.592030:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415792000 00000100:00100000:2.0:1789708702.592041:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415792000 00010000:00010000:2.0:1789708702.592073:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686673a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4920 expref: 31 pid: 11601 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708702.592115:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 48 00000100:00100000:2.0:1789708702.592123:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+31:2362:x1876645415792000:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708702.592135:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708702.592141:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686673a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4920 expref: 31 pid: 11601 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.592152:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686673a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4920 expref: 31 pid: 11601 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.592171:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686673a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4920 expref: 31 pid: 11601 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.592195:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38500) 00010000:00010000:2.0:1789708702.592200:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866795 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.592210:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.592231:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866795 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.592517:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708702.592578:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+30:2362:x1876645415792000:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 454us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708702.592586:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 48 00010000:00010000:1.0:1789708702.593182:0:11601:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.593236:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.593267:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.593274:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866795 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.593280:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866795 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.593286:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708702.593290:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866795 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.593298:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866795 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.593309:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38500) 00010000:00010000:1.0:1789708702.593312:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708702.593316:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866795 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708702.593336:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866795 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708702.593475:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+29:10469:x1876645415791616:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 7733us (8071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708702.593483:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 92 00000100:00100000:3.0:1789708702.595913:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708702.596032:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415792256 00000100:00100000:2.0:1789708702.596041:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415792256 00000100:00100000:2.0:1789708702.596103:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:2.0:1789708702.596111:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+29:10469:x1876645415792256:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1789708702.596406:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+30:10469:x1876645415792256:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 294us (501us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789708702.596414:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:3.0:1789708702.674408:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708702.674626:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415792512 00000100:00100000:2.0:1789708702.674635:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415792512 00000100:00100000:2.0:1789708702.674726:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 93 00000100:00100000:2.0:1789708702.674736:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+30:10480:x1876645415792512:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:2.0:1789708702.674761:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708702.674781:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686679c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d493c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.674862:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.674874:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.674904:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.674917:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.674924:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.674930:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675303:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68667b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675313:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68667b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675324:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68667b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708702.675333:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789708702.675588:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675595:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675602:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675607:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6ba00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708702.675617:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675624:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675635:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:2.0:1789708702.675638:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708702.675642:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675647:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675684:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675690:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675696:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675702:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6bc00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708702.675706:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675710:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675718:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1414c38400) 00010000:00010000:2.0:1789708702.675720:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708702.675729:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675736:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675780:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686679c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d493c expref: 33 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675794:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68667b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d493c expref: 32 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.675862:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38500) 00010000:00010000:2.0:1789708702.675865:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708702.675867:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6a000, rc 0) 00000100:00100000:2.0:1789708702.675990:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+32:10480:x1876645415792512:12345-192.168.202.53@tcp:101:cat.0 Request processed in 1255us (1589us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789708702.675998:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 93 00000100:00100000:3.0:1789708702.681304:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708702.681520:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415792768 00000100:00100000:0.0:1789708702.681530:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415792768 00000100:00100000:0.0:1789708702.681589:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:0.0:1789708702.681597:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+32:10480:x1876645415792768:12345-192.168.202.53@tcp:35:cat.0 00000100:00100000:0.0:1789708702.681873:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+33:10480:x1876645415792768:12345-192.168.202.53@tcp:35:cat.0 Request processed in 275us (579us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789708702.681880:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:1.0:1789708702.700869:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708702.700971:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415793024 00000100:00100000:3.0:1789708702.700983:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415793024 00000100:00100000:3.0:1789708702.701038:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 94 00000100:00100000:3.0:1789708702.701046:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+33:10481:x1876645415793024:12345-192.168.202.53@tcp:36:rm.0 00010000:00010000:3.0:1789708702.701109:0:7140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789708702.701138:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68667b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d493c expref: 33 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.701177:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866787 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4935 expref: 32 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.701196:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c686674f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4927 expref: 31 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.701208:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1414c38500) 00010000:00010000:3.0:1789708702.701218:0:7140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708702.701238:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68667bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.701261:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68667bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.701277:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68667bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.701295:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68667c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.701302:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68667c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.701308:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68667c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.701919:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68667cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.701928:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68667cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.701941:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68667cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708702.702805:0:7140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1789708702.702815:0:7140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 268500164117ns, next at 269500161284ns, rc = 0 00010000:00010000:3.0:1789708702.702867:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68667d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.702877:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68667d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.702885:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68667d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.702891:0:7140:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68667d4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.702898:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68667d4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.702904:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68667d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.702964:0:7140:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708702.702983:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68667cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.702988:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68667cd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.702994:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68667cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.703005:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708702.703010:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68667cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.703017:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68667cd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.703028:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1411b4a000) 00010000:00010000:3.0:1789708702.703031:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789708702.703034:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68667cd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.703040:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68667cd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.703054:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68667bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.703059:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68667bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.703065:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68667bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.703069:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708702.703072:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68667bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.703077:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68667bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.703100:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:3.0:1789708702.703102:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708702.703106:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68667bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.703111:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c68667bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708702.703119:0:7140:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b365048 reply state 00000000c3d3ba08 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68667c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708702.703127:0:7140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789708702.703547:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+32:10481:x1876645415793024:12345-192.168.202.53@tcp:36:rm.0 Request processed in 2497us (2683us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789708702.703557:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 94 00010000:00010000:0.0:1789708702.704022:0:8434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708702.704030:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68667d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.704038:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38800 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708702.704041:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68667d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.704048:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68667d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.704071:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a1411b4a000) 00010000:00010000:0.0:1789708702.704073:0:8434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789708702.704076:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68667d4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.704081:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c68667d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708702.704860:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708702.704862:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708702.704864:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708702.713759:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68667c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.713777:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68667c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.713785:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68667c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.713792:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708702.713798:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68667c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.713806:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68667c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.713852:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1411b4a600) 00010000:00010000:3.0:1789708702.713854:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708702.713860:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68667c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.713866:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68667c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708702.748752:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708702.748862:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415793280 00000100:00100000:2.0:1789708702.748874:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415793280 00000100:00100000:2.0:1789708702.748944:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 95 00000100:00100000:2.0:1789708702.748964:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+31:10487:x1876645415793280:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1789708702.748988:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708702.749010:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68667db lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4943 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.749132:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.749162:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.749172:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.749187:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.749193:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.749199:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789708702.749967:0:11601:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789708702.750372:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68667f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.750385:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68667f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.750393:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68667f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.750424:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.750431:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.750438:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.750447:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6bc00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708702.750452:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.750459:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.750469:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:2.0:1789708702.750472:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708702.750476:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.750482:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68667e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789708702.750494:0:11601:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7253ce2 reply state 00000000ded3aa44 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708702.750501:0:11601:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789708702.750529:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68667db lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4943 expref: 34 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.750542:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68667f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4943 expref: 33 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.750548:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38200) 00010000:00010000:2.0:1789708702.750550:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708702.750552:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6ac00, rc 0) 00000100:00100000:2.0:1789708702.750695:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+34:10487:x1876645415793280:12345-192.168.202.53@tcp:101:bash.0 Request processed in 1741us (1952us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789708702.750712:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 95 00000100:00100000:1.0:1789708702.754689:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00010000:00010000:2.0:1789708702.754784:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.754798:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.754806:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.754819:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6ba00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708702.754823:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.754831:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.754851:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1414c38400) 00010000:00010000:2.0:1789708702.754854:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708702.754859:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708702.754865:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68667e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708702.754938:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415793408 00000100:00100000:3.0:1789708702.754947:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415793408 00000100:00100000:3.0:1789708702.755014:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:3.0:1789708702.755022:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2362:x1876645415793408:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:3.0:1789708702.755039:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708702.755056:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1a62492/0xa8f741d1c68667fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d494a expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789708702.755078:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789708702.755096:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=268s v=(0 0) 00010000:00010000:3.0:1789708702.755100:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708702.755108:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a62492/0xa8f741d1c68667fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d494a expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.755123:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1a62492/0xa8f741d1c68667fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d494a expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.755133:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39e00, rc 0) 00000100:00100000:3.0:1789708702.755195:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2362:x1876645415793408:12345-192.168.202.53@tcp:101:bash.0 Request processed in 167us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708702.755215:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00080000:0.0:1789708702.755724:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708702.758874:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708702.759010:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415793536 00000100:00100000:3.0:1789708702.759020:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415793536 00000100:00100000:3.0:1789708702.759076:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00100000:3.0:1789708702.759091:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+6:10487:x1876645415793536:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:3.0:1789708702.759110:0:10424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708702.759126:0:10424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030b66fa8/0xa8f741d1c6866805 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4951 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.759157:0:10424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1a62492/0xa8f741d1c68667fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d494a expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.759165:0:10424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708702.759169:0:10424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708702.759173:0:10424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030b66fa8/0xa8f741d1c6866805 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4951 expref: 7 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.759214:0:10424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1a62492/0xa8f741d1c68667fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d494a expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.759226:0:10424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1a62492/0xa8f741d1c68667fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d494a expref: 7 pid: 6672 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708702.759239:0:10424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f53f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10424:1876645426288768:192.168.202.53@tcp:104: 00000100:00100000:3.0:1789708702.759596:0:10424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140994a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708702.762231:0:10424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f53f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10424:1876645426288768:192.168.202.53@tcp:104: 00010000:00010000:3.0:1789708702.762282:0:10424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000030b66fa8/0xa8f741d1c6866805 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4951 expref: 7 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.762309:0:10424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38200, rc 0) 00000100:00100000:3.0:1789708702.762364:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+7:10487:x1876645415793536:12345-192.168.202.53@tcp:101:bash.0 Request processed in 3280us (3499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708702.762373:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00100000:1.0:1789708702.764439:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708702.764580:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415793664 00000100:00100000:3.0:1789708702.764588:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415793664 00010000:00010000:3.0:1789708702.764631:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a62492/0xa8f741d1c68667fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d494a expref: 7 pid: 6672 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708702.764711:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:3.0:1789708702.764721:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1407f56450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2361:x1876645415793664:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708702.764737:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708702.764759:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1a62492/0xa8f741d1c68667fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d494a expref: 7 pid: 6672 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.764772:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1a62492/0xa8f741d1c68667fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d494a expref: 7 pid: 6672 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.764794:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1a62492/0xa8f741d1c68667fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d494a expref: 7 pid: 6672 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.764810:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708702.764828:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708702.764837:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000030b66fa8/0xa8f741d1c6866805 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4951 expref: 6 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.764847:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030b66fa8/0xa8f741d1c6866805 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4951 expref: 6 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708702.764886:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000030b66fa8/0xa8f741d1c6866805 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4951 expref: 6 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708702.765012:0:5806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f53f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5806:1876645426288896:192.168.202.53@tcp:105: 00000100:00100000:2.0:1789708702.768536:0:5806:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140994a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708702.774974:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708702.775087:0:5806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f53f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5806:1876645426288896:192.168.202.53@tcp:105: 00010000:00010000:2.0:1789708702.775112:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708702.775169:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1407f56450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415793664:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 10449us (10737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708702.775205:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:0.0:1789708702.776746:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415793920 00000100:00100000:0.0:1789708702.776758:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415793920 00000100:00100000:0.0:1789708702.776850:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:0.0:1789708702.776863:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+33:10487:x1876645415793920:12345-192.168.202.53@tcp:35:bash.0 00000100:00100000:0.0:1789708702.777216:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+34:10487:x1876645415793920:12345-192.168.202.53@tcp:35:bash.0 Request processed in 356us (2262us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789708702.777223:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 25 00010000:00010000:1.0:1789708702.842855:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708703.023747:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708703.024003:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415794048 00000100:00100000:3.0:1789708703.024014:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415794048 00000100:00100000:3.0:1789708703.024086:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 96 00000100:00100000:3.0:1789708703.024095:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+34:10503:x1876645415794048:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1789708703.024120:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708703.024304:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c686680c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4958 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.024378:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866813 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.024394:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.024405:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708703.024443:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789708703.024458:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789708703.024479:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.024504:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c686680c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4958 expref: 36 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.024521:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866813 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4958 expref: 35 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.024530:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:3.0:1789708703.024532:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789708703.024535:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38c00, rc 0) 00000100:00100000:3.0:1789708703.024590:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+35:10503:x1876645415794048:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 496us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708703.024597:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 96 00000100:00100000:1.0:1789708703.042471:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708703.043193:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415794304 00000100:00100000:3.0:1789708703.043203:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415794304 00000100:00100000:3.0:1789708703.043265:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 97 00000100:00100000:3.0:1789708703.043276:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+35:10503:x1876645415794304:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1789708703.043297:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708703.043319:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c686681a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d495f expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.043424:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866821 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.043438:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.043468:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708703.043480:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789708703.043624:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c686681a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d495f expref: 38 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.043641:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866821 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d495f expref: 37 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.043685:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38200) 00010000:00010000:3.0:1789708703.043689:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708703.043693:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38600, rc 0) 00000100:00100000:3.0:1789708703.043749:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+37:10503:x1876645415794304:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 475us (1288us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1789708703.043756:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 97 00000100:00100000:1.0:1789708703.051804:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708703.052252:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415794688 00000100:00100000:3.0:1789708703.052263:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415794688 00000100:00100000:1.0:1789708703.054338:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708703.054495:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:3.0:1789708703.054511:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+37:2363:x1876645415794688:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708703.054534:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708703.054563:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866821 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d495f expref: 37 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.054583:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38200) 00010000:00010000:3.0:1789708703.054588:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708703.054707:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+36:2363:x1876645415794688:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 201us (2921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708703.054714:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:0.0:1789708703.055830:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415794560 00000100:00100000:0.0:1789708703.055842:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415794560 00000100:00100000:0.0:1789708703.055894:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 98 00000100:00100000:0.0:1789708703.055903:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+36:10503:x1876645415794560:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1789708703.055926:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708703.055945:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23400/0xa8f741d1c686682f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4966 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.056074:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22400/0xa8f741d1c6866836 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.056100:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22400/0xa8f741d1c6866836 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.056112:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22400/0xa8f741d1c6866836 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708703.056133:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789708703.056268:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23400/0xa8f741d1c686682f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4966 expref: 39 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.056287:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22400/0xa8f741d1c6866836 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4966 expref: 38 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.056295:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38200) 00010000:00010000:0.0:1789708703.056297:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789708703.056300:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d22400, rc 0) 00000100:00100000:0.0:1789708703.056349:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+38:10503:x1876645415794560:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 447us (2019us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1789708703.056356:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 98 00000100:00100000:1.0:1789708703.074731:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708703.075071:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415794816 00000100:00100000:3.0:1789708703.075092:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415794816 00000100:00100000:3.0:1789708703.075149:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:3.0:1789708703.075158:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2364:x1876645415794816:12345-192.168.202.53@tcp:1:lfs.0 00010000:00010000:3.0:1789708703.075214:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000989de4e5/0xa8f741d1c6866844 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.075234:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000030b66fa8/0xa8f741d1c6866805 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4951 expref: 6 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.075243:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708703.075247:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789708703.075252:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000989de4e5/0xa8f741d1c6866844 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.075287:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000030b66fa8/0xa8f741d1c6866805 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4951 expref: 6 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.075301:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000030b66fa8/0xa8f741d1c6866805 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4951 expref: 6 pid: 10424 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708703.075316:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f53d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6672:1876645426289024:192.168.202.53@tcp:104: 00000100:00100000:3.0:1789708703.075399:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140994a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708703.101159:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f53d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6672:1876645426289024:192.168.202.53@tcp:104: 00010000:00010000:3.0:1789708703.101214:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000989de4e5/0xa8f741d1c6866844 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708703.105702:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708703.107207:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415794944 00000100:00100000:0.0:1789708703.107222:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415794944 00002000:00100000:0.0:1789708703.107273:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8a1426d0aa00 x1876645415794944/t0(0) o4->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:89/0 lens 504/0 e 0 to 0 dl 1789708714 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789708703.107284:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1426d0aa00 with x1876645415794944 ext(0->8) 00010000:00010000:0.0:1789708703.107307:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000030b66fa8/0xa8f741d1c6866805 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4951 expref: 7 pid: 10424 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.107324:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000030b66fa8/0xa8f741d1c6866805 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4951 expref: 7 pid: 10424 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708703.107333:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a1426d0aa00 00000100:00100000:0.0:1789708703.107360:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:0.0:1789708703.107369:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2362:x1876645415794944:12345-192.168.202.53@tcp:4:lfs.0 00000100:00100000:0.0:1789708703.107900:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+9:2362:x1876645415794944:12345-192.168.202.53@tcp:4:lfs.0 Request processed in 530us (2261us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789708703.107909:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 1 00002000:00100000:0.0:1789708703.107917:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8a1426d0aa00 x1876645415794944/t4294967302(0) o4->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:89/0 lens 504/448 e 0 to 0 dl 1789708714 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789708703.107927:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1426d0aa00 with x1876645415794944 ext(0->8) 00010000:00010000:0.0:1789708703.107933:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000030b66fa8/0xa8f741d1c6866805 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4951 expref: 9 pid: 10424 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.107946:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000030b66fa8/0xa8f741d1c6866805 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4951 expref: 9 pid: 10424 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708703.110049:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a1426d0aa00 00000100:00100000:1.0:1789708703.116822:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708703.118624:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415795072 00000100:00100000:2.0:1789708703.118641:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415795072 00010000:00010000:2.0:1789708703.118733:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000030b66fa8/0xa8f741d1c6866805 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4951 expref: 9 pid: 10424 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708703.118772:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:2.0:1789708703.119535:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+9:2361:x1876645415795072:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708703.119556:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789708703.119579:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789708703.119582:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789708703 00002000:00010000:2.0:1789708703.119585:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789708703 00002000:00010000:2.0:1789708703.119588:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789708703 00010000:00010000:2.0:1789708703.119594:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000030b66fa8/0xa8f741d1c6866805 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4951 expref: 9 pid: 10424 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.119611:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000030b66fa8/0xa8f741d1c6866805 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4951 expref: 9 pid: 10424 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.119638:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030b66fa8/0xa8f741d1c6866805 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4951 expref: 9 pid: 10424 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.119683:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708703.119689:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708703.119696:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000989de4e5/0xa8f741d1c6866844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.119720:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000989de4e5/0xa8f741d1c6866844 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.119749:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708703.120112:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000989de4e5/0xa8f741d1c6866844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.120134:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000989de4e5/0xa8f741d1c6866844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.120161:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000989de4e5/0xa8f741d1c6866844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.120175:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000989de4e5/0xa8f741d1c6866844 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.120183:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000989de4e5/0xa8f741d1c6866844 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.120190:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38600 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708703.120194:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000989de4e5/0xa8f741d1c6866844 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.120202:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000989de4e5/0xa8f741d1c6866844 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.120213:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000989de4e5/0xa8f741d1c6866844 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.120220:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000989de4e5/0xa8f741d1c6866844 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708703.121858:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2361:x1876645415795072:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 3069us (5039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708703.121871:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:1.0:1789708703.121987:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2364:x1876645415794816:12345-192.168.202.53@tcp:1:lfs.0 Request processed in 46829us (47265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708703.121995:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:0.0:1789708703.138542:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708703.138684:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415795328 00000100:00100000:1.0:1789708703.138697:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415795328 00000100:00100000:1.0:1789708703.138767:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 26 00000100:00100000:1.0:1789708703.138792:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14069f9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+38:10503:x1876645415795328:12345-192.168.202.53@tcp:35:lfs.0 00000004:00010000:1.0:1789708703.138859:0:5823:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22400/0xa8f741d1c6866836 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4966 expref: 38 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789708703.139215:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1789708703.139263:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1789708703.141611:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1789708703.141718:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c686684b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.141737:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68667f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4943 expref: 42 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.141747:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c686684b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.141789:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68667f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4943 expref: 42 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.141804:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68667f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4943 expref: 42 pid: 11601 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708703.141818:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1426d09500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5823:1876645426289152:192.168.202.53@tcp:104: 00000100:00100000:1.0:1789708703.141914:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140319f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708703.153966:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1426d09500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5823:1876645426289152:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708703.153999:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c686684b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789708703.156634:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1789708703.157007:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708703.157421:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415795456 00000100:00100000:1.0:1789708703.157431:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415795456 00010000:00010000:1.0:1789708703.157469:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68667f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4943 expref: 43 pid: 11601 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708703.157533:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:1.0:1789708703.157544:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410808a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+43:2361:x1876645415795456:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708703.157560:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708703.157568:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68667f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4943 expref: 43 pid: 11601 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.157581:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68667f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4943 expref: 43 pid: 11601 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.157601:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c68667f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4943 expref: 43 pid: 11601 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.157616:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38200) 00010000:00010000:1.0:1789708703.157622:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c686684b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.157632:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c686684b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.157640:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c686684b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.157700:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708703.157753:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410808a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+42:2361:x1876645415795456:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 211us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708703.157761:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 51 00010000:00010000:1.0:1789708703.157875:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c686684b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.157889:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c686684b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789708703.158022:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1789708703.161163:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1789708703.161610:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1426d0a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5823:1876645426289280:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789708703.163744:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708703.163827:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140390d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789708703.165423:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426289280 00000100:00100000:2.0:1789708703.165436:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426289280 00000100:00100000:2.0:1789708703.165504:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789708703.165514:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1876645426289280:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789708703.165741:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1876645426289280:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 228us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708703.165749:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789708703.166004:0:5823:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1789708703.166011:0:5823:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1789708703.166048:0:5823:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a143f271f80, transno 4294967301 00000100:00100000:1.0:1789708703.166072:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1426d0a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5823:1876645426289280:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789708703.166797:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1789708703.166863:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1426d0a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5823:1876645426289408:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789708703.166909:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708703.167007:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140319f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789708703.167047:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426289408 00000100:00100000:0.0:1789708703.167053:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426289408 00000100:00100000:0.0:1789708703.167142:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789708703.167152:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5823:x1876645426289408:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789708703.167510:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5823:x1876645426289408:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 360us (599us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789708703.167517:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789708703.167591:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1426d0a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5823:1876645426289408:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789708703.167636:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1789708703.167692:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c686684b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.167708:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c686684b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.167725:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c686684b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.167731:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708703.167735:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c686684b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.167743:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c686684b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.167756:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38200) 00010000:00010000:2.0:1789708703.167759:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789708703.167763:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c686684b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.167768:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c686684b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789708703.167908:0:5823:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789708703.167988:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1789708703.167999:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 268965348171ns, next at 269965345338ns, rc = 0 00000001:00080000:2.0:1789708703.168004:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1789708703.168035:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38200) 00010000:00010000:2.0:1789708703.168038:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789708703.168045:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22400/0xa8f741d1c6866836 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4966 expref: 46 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708703.168138:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14069f9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+45:10503:x1876645415795328:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 29349us (29605us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1789708703.168155:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 26 00000020:00080000:2.0:1789708703.168159:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789708703.171006:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708703.173922:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415795584 00000100:00100000:2.0:1789708703.173938:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415795584 00000100:00100000:2.0:1789708703.174021:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 99 00000100:00100000:2.0:1789708703.174031:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+45:10503:x1876645415795584:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708703.174057:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708703.174082:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866852 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d496d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.174686:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866852 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d496d expref: 46 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.174703:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866852 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d496d expref: 46 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.174725:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:2.0:1789708703.174728:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789708703.174731:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6ba00, rc 0) 00000100:00100000:2.0:1789708703.174796:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+46:10503:x1876645415795584:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 766us (3798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708703.174804:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 99 00000100:00100000:1.0:1789708703.179473:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708703.179569:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415795840 00000100:00100000:0.0:1789708703.179579:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415795840 00000100:00100000:0.0:1789708703.179682:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:0.0:1789708703.179692:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+46:10503:x1876645415795840:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:0.0:1789708703.179948:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+47:10503:x1876645415795840:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 257us (542us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1789708703.179965:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:1.0:1789708703.568156:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708703.568270:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415795968 00000100:00100000:2.0:1789708703.568281:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415795968 00000100:00100000:2.0:1789708703.568349:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 100 00000100:00100000:2.0:1789708703.568359:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+47:10512:x1876645415795968:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:2.0:1789708703.568443:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866859 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568460:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866859 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568473:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866859 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568492:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866860 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568497:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568501:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568575:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866867 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568580:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568585:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789708703.568618:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568627:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866859 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568638:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866859 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568643:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866859 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568672:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6be00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708703.568675:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866859 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568680:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866859 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568689:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:2.0:1789708703.568691:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708703.568694:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866859 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568698:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866859 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568708:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866860 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568712:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866860 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568715:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866860 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568719:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6bc00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708703.568724:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866860 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568728:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866860 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568733:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1414c38200) 00010000:00010000:2.0:1789708703.568734:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708703.568735:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866860 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568739:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866860 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568749:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568753:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866867 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568757:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866867 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568759:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6ac00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708703.568761:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866867 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568764:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866867 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568767:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:2.0:1789708703.568768:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708703.568773:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866867 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.568777:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866867 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708703.568839:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+47:10512:x1876645415795968:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 481us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708703.568847:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 100 00000100:00100000:3.0:1789708703.651323:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708703.651405:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415796224 00000100:00100000:0.0:1789708703.651417:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415796224 00000100:00100000:0.0:1789708703.651486:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 101 00000100:00100000:0.0:1789708703.651498:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+47:10516:x1876645415796224:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1789708703.651520:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708703.651543:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686686e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4974 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.651632:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866875 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.651668:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866875 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.651678:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866875 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.651706:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c686687c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.651711:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c686687c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.651715:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c686687c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.651806:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866883 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.651811:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866883 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.651815:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866883 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708703.652007:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789708703.652800:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866875 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.654029:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866875 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.654046:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866875 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.654052:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708703.654057:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866875 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.654086:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866875 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.654103:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:0.0:1789708703.654106:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708703.654112:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866875 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.654118:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866875 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.654137:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c686687c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.654143:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c686687c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.654148:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c686687c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.654153:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708703.654155:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c686687c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.654161:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c686687c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.654168:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a14148f3c00) 00010000:00010000:0.0:1789708703.654170:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708703.654173:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c686687c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.654259:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c686687c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.654323:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686686e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4974 expref: 50 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.654337:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866883 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4974 expref: 49 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.654343:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:0.0:1789708703.654345:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708703.654348:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d22e00, rc 0) 00000100:00100000:0.0:1789708703.654499:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+49:10516:x1876645415796224:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 3003us (3198us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1789708703.654510:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 101 00000100:00100000:1.0:1789708703.661941:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708703.662090:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415796352 00000100:00100000:3.0:1789708703.662101:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415796352 00000100:00100000:3.0:1789708703.662166:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 102 00000100:00100000:3.0:1789708703.662176:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+49:10516:x1876645415796352:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:3.0:1789708703.662257:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866891 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.662273:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.662285:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.662313:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.662321:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866891 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.662327:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866891 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.662332:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708703.662337:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866891 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.662362:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866891 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.662374:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:3.0:1789708703.662377:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789708703.662381:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866891 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.662387:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866891 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708703.662629:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+49:10516:x1876645415796352:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 454us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708703.662638:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 102 00000100:00100000:1.0:1789708703.665782:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708703.666007:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415796608 00000100:00100000:2.0:1789708703.666017:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415796608 00000100:00100000:2.0:1789708703.666077:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:2.0:1789708703.666087:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+49:10516:x1876645415796608:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1789708703.668679:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+50:10516:x1876645415796608:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 2585us (2896us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789708703.668690:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:1.0:1789708703.826034:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708703.826124:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415796864 00000100:00100000:0.0:1789708703.826135:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415796864 00000100:00100000:0.0:1789708703.826208:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 103 00000100:00100000:0.0:1789708703.826220:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+50:10526:x1876645415796864:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1789708703.826246:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708703.826249:0:11601:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789708703.826278:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866813 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4958 expref: 50 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.826298:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:0.0:1789708703.826304:0:11601:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708703.826342:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c6866898 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d497b expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.826445:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c686689f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.826459:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c686689f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.826469:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c686689f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708703.826480:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789708703.826603:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c6866898 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d497b expref: 52 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.826619:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c686689f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d497b expref: 51 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.826626:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:0.0:1789708703.826630:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708703.826632:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23e00, rc 0) 00000100:00100000:0.0:1789708703.826750:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+51:10526:x1876645415796864:12345-192.168.202.53@tcp:101:bash.0 Request processed in 532us (726us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789708703.826758:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 103 00000100:00100000:1.0:1789708703.831440:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708703.831614:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415797120 00000100:00100000:3.0:1789708703.831632:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415797120 00000100:00100000:3.0:1789708703.831769:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 104 00000100:00100000:3.0:1789708703.831779:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+51:10526:x1876645415797120:12345-192.168.202.53@tcp:36:bash.0 00010000:00010000:3.0:1789708703.831859:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789708703.831886:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c686689f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d497b expref: 51 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.831909:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866883 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4974 expref: 50 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.831920:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:3.0:1789708703.831925:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708703.832192:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.832207:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.832217:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789708703.832483:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1789708703.832509:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066eaab1e reply state 0000000036a6dd00 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708703.832517:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789708703.832941:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+52:10526:x1876645415797120:12345-192.168.202.53@tcp:36:bash.0 Request processed in 1161us (1514us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789708703.833025:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 104 00000020:00080000:3.0:1789708703.833032:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789708703.836547:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.836565:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.836572:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.836579:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708703.836584:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.836592:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.836626:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:3.0:1789708703.836629:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708703.836635:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.836642:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708703.837729:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708703.838024:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415797248 00000100:00100000:3.0:1789708703.838036:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415797248 00000100:00100000:3.0:1789708703.838210:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 105 00000100:00100000:3.0:1789708703.838221:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+51:10526:x1876645415797248:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:3.0:1789708703.838265:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708703.838287:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c68668b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4982 expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.838383:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68668bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.838398:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68668bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.838409:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68668bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708703.838517:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789708703.838522:0:7140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789708703.838539:0:7140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68668bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.838579:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c68668b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4982 expref: 53 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.838595:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68668bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4982 expref: 52 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.838604:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:3.0:1789708703.838607:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708703.838611:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38c00, rc 0) 00000100:00100000:3.0:1789708703.838829:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+52:10526:x1876645415797248:12345-192.168.202.53@tcp:101:bash.0 Request processed in 603us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708703.838838:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 105 00000100:00100000:1.0:1789708703.841972:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708703.842380:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415797504 00000100:00100000:0.0:1789708703.842390:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415797504 00000100:00100000:0.0:1789708703.842564:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:0.0:1789708703.842574:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+52:10526:x1876645415797504:12345-192.168.202.53@tcp:35:bash.0 00000100:00100000:0.0:1789708703.842872:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+53:10526:x1876645415797504:12345-192.168.202.53@tcp:35:bash.0 Request processed in 298us (908us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1789708703.842879:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 29 00010000:00010000:3.0:1789708703.867007:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708703.959791:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708703.966029:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415797632 00000100:00100000:1.0:1789708703.966045:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415797632 00000100:00100000:1.0:1789708703.966772:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 106 00000100:00100000:1.0:1789708703.966800:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+53:10532:x1876645415797632:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1789708703.966826:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708703.966845:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c68668c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4989 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.966913:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c68668c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.966928:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c68668c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.966940:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c68668c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708703.966992:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789708703.966997:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789708703.967016:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c68668c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.967041:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c68668c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4989 expref: 55 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.967074:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c68668c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4989 expref: 54 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.967083:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:1.0:1789708703.967096:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708703.967099:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4c00, rc 0) 00000100:00100000:1.0:1789708703.967167:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+54:10532:x1876645415797632:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 372us (7397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708703.967352:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 106 00000100:00100000:3.0:1789708703.972021:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708703.973246:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415797760 00000100:00100000:2.0:1789708703.973260:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415797760 00000100:00100000:2.0:1789708703.973329:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 107 00000100:00100000:2.0:1789708703.973340:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+54:10532:x1876645415797760:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708703.973362:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708703.973382:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68668d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4990 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973461:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68668d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973476:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68668d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973500:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68668d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973515:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68668de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973522:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68668de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973528:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68668de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973614:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68668e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973623:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68668e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973629:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68668e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708703.973691:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789708703.973695:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789708703.973712:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68668e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973724:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68668e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973733:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68668d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973750:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68668d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973757:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68668d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973763:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6be00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708703.973767:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68668d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973774:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68668d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973786:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:2.0:1789708703.973789:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708703.973794:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68668d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973800:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68668d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973813:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68668de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973819:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68668de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973826:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68668de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973830:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708703.973839:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68668de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973845:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68668de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973853:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a1414c38200) 00010000:00010000:2.0:1789708703.973856:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708703.973859:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68668de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973866:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68668de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973898:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c68668d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4990 expref: 56 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973911:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68668e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4990 expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708703.973919:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:2.0:1789708703.973921:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708703.973924:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6a000, rc 0) 00000100:00100000:2.0:1789708703.974331:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+55:10532:x1876645415797760:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 992us (2320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708703.974340:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 107 00000100:00100000:2.0:1789708703.979785:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708703.979874:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708703.979940:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415798144 00000100:00100000:0.0:1789708703.979960:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415798144 00000100:00100000:0.0:1789708703.980029:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:0.0:1789708703.980041:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+55:2362:x1876645415798144:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708703.980068:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708703.980102:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c68668e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4990 expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.980124:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:0.0:1789708703.980130:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708703.980504:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+54:2362:x1876645415798144:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 465us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708703.980513:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:3.0:1789708703.982355:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415798016 00000100:00100000:3.0:1789708703.982371:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415798016 00000100:00100000:3.0:1789708703.982454:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 108 00000100:00100000:3.0:1789708703.982463:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+54:10532:x1876645415798016:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1789708703.982486:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708703.982508:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c68668ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4997 expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.982611:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.982628:0:7140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68668bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4982 expref: 55 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.982771:0:7140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668f3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.982809:0:7140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68668bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4982 expref: 55 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.982823:0:7140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68668bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4982 expref: 55 pid: 7140 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708703.982838:0:7140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f53df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7140:1876645426289536:192.168.202.53@tcp:104: 00000100:00100000:3.0:1789708703.983024:0:7140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140994af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708703.987619:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708703.987726:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415798272 00000100:00100000:1.0:1789708703.987736:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415798272 00010000:00010000:1.0:1789708703.987774:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68668bb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4982 expref: 56 pid: 7140 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708703.987810:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:1.0:1789708703.987820:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+56:2361:x1876645415798272:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708703.987836:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708703.987843:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68668bb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4982 expref: 56 pid: 7140 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.987856:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68668bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4982 expref: 56 pid: 7140 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.987878:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:1.0:1789708703.987882:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.987893:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.987900:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668f3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708703.987918:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708703.987983:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+56:2361:x1876645415798272:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 163us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708703.988007:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 52 00010000:00010000:3.0:1789708703.990569:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c68668bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4982 expref: 55 pid: 7140 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708703.990592:0:7140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f53df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7140:1876645426289536:192.168.202.53@tcp:104: 00010000:00010000:3.0:1789708703.990617:0:7140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.990626:0:7140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.990631:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708703.990810:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789708703.993364:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c68668ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4997 expref: 56 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.993485:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4997 expref: 55 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708703.993495:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:3.0:1789708703.993498:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789708703.993501:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39e00, rc 0) 00000100:00100000:3.0:1789708703.993629:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+55:10532:x1876645415798016:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 11165us (13858us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789708703.993638:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 108 00000100:00100000:2.0:1789708703.998018:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708703.998533:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415798528 00000100:00100000:0.0:1789708703.998543:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415798528 00000100:00100000:0.0:1789708703.999792:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:0.0:1789708703.999815:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+55:10532:x1876645415798528:12345-192.168.202.53@tcp:103:lfs.0 00010000:00010000:0.0:1789708703.999845:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708703.999873:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866852 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d496d expref: 55 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708703.999893:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:0.0:1789708703.999898:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708704.000079:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+54:10532:x1876645415798528:12345-192.168.202.53@tcp:103:lfs.0 Request processed in 274us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708704.000087:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:2.0:1789708704.002719:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708704.002816:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415798656 00000100:00100000:3.0:1789708704.002836:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415798656 00000100:00100000:3.0:1789708704.002903:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 109 00000100:00100000:3.0:1789708704.002914:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+54:10532:x1876645415798656:12345-192.168.202.53@tcp:58:lfs.0 00010000:00010000:3.0:1789708704.003059:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866901 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.003078:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866901 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.003091:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866901 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708704.003334:0:11601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789708704.003414:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+54:10532:x1876645415798656:12345-192.168.202.53@tcp:58:lfs.0 Request processed in 502us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708704.003423:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 109 00000100:00080000:1.0:1789708704.003726:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708704.006998:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708704.007290:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415798784 00000100:00100000:0.0:1789708704.007300:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415798784 00000100:00100000:0.0:1789708704.007353:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 110 00000100:00100000:0.0:1789708704.007364:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+54:10532:x1876645415798784:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1789708704.007387:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708704.009437:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c6866908 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d499e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.009527:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866901 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.009542:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c6866908 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d499e expref: 55 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.009566:0:5819:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866901 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.009586:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c6866908 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d499e expref: 55 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.009600:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:0.0:1789708704.009603:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708704.009607:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c6866908 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d499e expref: 55 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.009614:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d22000, rc 0) 00000100:00100000:1.0:1789708704.015611:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+55:10532:x1876645415798784:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 8235us (8608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708704.015626:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 110 00000040:00080000:0.0:1789708704.571169:0:11657:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789708704.571179:0:11657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789708704.571240:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789708704.571255:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789708704.572203:0:11657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1410808e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11657:1876645426289664:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789708704.572367:0:11657:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140a9db240 going to sleep for 11 seconds 00000100:00100000:0.0:1789708704.575691:0:11657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1410808e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11657:1876645426289664:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789708704.577472:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708704.580829:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415798912 00000100:00100000:3.0:1789708704.580843:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415798912 00000100:00100000:3.0:1789708704.580985:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 111 00000100:00100000:3.0:1789708704.580995:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143ec30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+55:10533:x1876645415798912:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789708704.581031:0:7140:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789708704.581183:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143ec30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+55:10533:x1876645415798912:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 189us (3716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708704.581190:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 111 00000100:00100000:3.0:1789708704.587197:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708704.587529:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415799040 00000100:00100000:2.0:1789708704.587539:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415799040 00000100:00100000:2.0:1789708704.587593:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 112 00000100:00100000:2.0:1789708704.587603:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+55:10533:x1876645415799040:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789708704.587688:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686690f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.587704:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686690f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.587717:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686690f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.587870:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866916 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.589087:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866916 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.589104:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866916 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.589136:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c686691d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.589146:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c686691d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.589153:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c686691d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708704.589209:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789708704.589214:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789708704.590118:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c686691d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590133:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686690f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590141:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686690f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590148:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686690f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590154:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708704.590158:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686690f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590165:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686690f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590184:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1411b4a700) 00010000:00010000:2.0:1789708704.590187:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708704.590191:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686690f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590197:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c686690f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590213:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866916 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590231:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866916 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590246:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866916 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590251:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6ba00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708704.590254:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866916 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590260:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866916 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590268:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8a1414c38200) 00010000:00010000:2.0:1789708704.590271:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708704.590274:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866916 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590280:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866916 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590296:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c686691d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590302:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c686691d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590310:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c686691d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590315:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6bc00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708704.590324:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c686691d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590330:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c686691d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590338:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:2.0:1789708704.590340:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708704.590343:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c686691d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.590349:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c686691d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708704.590452:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+55:10533:x1876645415799040:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 Request processed in 2846us (3261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708704.590462:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 112 00000100:00100000:2.0:1789708704.608194:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708704.610199:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415799296 00000100:00100000:1.0:1789708704.610216:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415799296 00000100:00100000:1.0:1789708704.610292:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 113 00000100:00100000:1.0:1789708704.610313:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+55:10533:x1876645415799296:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708704.610339:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708704.610357:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866924 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d49a5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.610448:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686692b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.610460:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686692b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.610468:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686692b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708704.610476:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789708704.610561:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686692b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.610567:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686692b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.610585:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686692b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.610589:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708704.610592:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686692b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.610596:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686692b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.610606:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:1.0:1789708704.610608:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789708704.610611:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686692b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.610615:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686692b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.610697:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866924 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49a5 expref: 57 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.610711:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1411b4a700) 00010000:00010000:1.0:1789708704.610714:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708704.610718:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866924 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49a5 expref: 57 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.610729:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5400, rc 0) 00000100:00100000:1.0:1789708704.610793:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+56:10533:x1876645415799296:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 493us (2606us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1789708704.610810:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 113 00000100:00100000:0.0:1789708704.615800:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708704.615880:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415799424 00000100:00100000:3.0:1789708704.615889:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415799424 00000100:00100000:3.0:1789708704.615933:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 114 00000100:00100000:3.0:1789708704.615961:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+56:10533:x1876645415799424:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789708704.615996:0:11601:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789708704.616479:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+56:10533:x1876645415799424:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 519us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708704.616486:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 114 00000100:00100000:2.0:1789708704.621273:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708704.622112:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415799680 00000100:00100000:1.0:1789708704.622124:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415799680 00000100:00100000:1.0:1789708704.622197:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 115 00000100:00100000:1.0:1789708704.622206:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+56:10533:x1876645415799680:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708704.622227:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708704.622230:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789708704.622254:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c68668c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4989 expref: 56 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.622273:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:1.0:1789708704.622277:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708704.622290:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866939 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d49ac expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789708704.622634:0:5820:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789708704.625352:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866940 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.625373:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.625385:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.625447:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866939 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49ac expref: 58 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.625485:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866940 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49ac expref: 57 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.625494:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a14033c4200) 00010000:00010000:1.0:1789708704.625497:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708704.625500:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5400, rc 0) 00000100:00100000:1.0:1789708704.625578:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+57:10533:x1876645415799680:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 3372us (4313us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789708704.625587:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 115 00000100:00100000:2.0:1789708704.631182:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708704.631785:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415799936 00000100:00100000:3.0:1789708704.631794:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415799936 00000100:00100000:3.0:1789708704.631855:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 116 00000100:00100000:3.0:1789708704.631866:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+57:10533:x1876645415799936:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789708704.631921:0:7140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708704.631957:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866940 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49ac expref: 57 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.631980:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a14033c4200) 00010000:00010000:3.0:1789708704.632007:0:7140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708704.632029:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c686694e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632055:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c686694e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632065:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c686694e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632076:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866955 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xacc47a07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632081:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866955 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xacc47a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632085:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866955 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xacc47a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632136:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c686694e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632140:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c686694e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632145:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c686694e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632148:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708704.632152:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c686694e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632157:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c686694e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632177:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:3.0:1789708704.632179:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708704.632182:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c686694e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632186:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c686694e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632192:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866955 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xacc47a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632196:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866955 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xacc47a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632200:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866955 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xacc47a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632203:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708704.632205:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866955 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xacc47a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632208:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866955 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xacc47a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632211:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xacc47a07 (ffff8a1411b4a500) 00010000:00010000:3.0:1789708704.632213:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708704.632214:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866955 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xacc47a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.632217:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866955 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xacc47a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708704.632306:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+56:10533:x1876645415799936:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 442us (1134us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789708704.632312:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 116 00000100:00100000:0.0:1789708704.634786:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708704.634854:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415800064 00000100:00100000:3.0:1789708704.634864:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415800064 00000100:00100000:3.0:1789708704.634954:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 117 00000100:00100000:3.0:1789708704.634965:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a141080ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+56:10533:x1876645415800064:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708704.634986:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708704.635008:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c686695c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d49b3 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.635037:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866963 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.635057:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.635065:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.635162:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c686695c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49b3 expref: 58 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.635182:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49b3 expref: 57 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.635188:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1411b4af00) 00010000:00010000:3.0:1789708704.635194:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789708704.635197:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38800, rc 0) 00000100:00100000:3.0:1789708704.635247:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a141080ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+57:10533:x1876645415800064:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 285us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708704.635254:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 117 00000100:00100000:0.0:1789708704.641275:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708704.641344:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415800320 00000100:00100000:1.0:1789708704.641354:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415800320 00000100:00100000:1.0:1789708704.641404:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 118 00000100:00100000:1.0:1789708704.641412:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+57:10533:x1876645415800320:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789708704.641482:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686696a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.641494:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686696a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.641503:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686696a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789708704.641716:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1789708704.641723:0:5820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 270439072865ns, next at 271439070735ns, rc = 0 00000004:00010000:1.0:1789708704.641788:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007acc8972 reply state 000000004bc15f42 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686696a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708704.641812:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789708704.641900:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+59:10533:x1876645415800320:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 489us (635us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1789708704.641905:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 118 00000100:00100000:0.0:1789708704.644089:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708704.645027:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415800448 00000100:00100000:3.0:1789708704.645045:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415800448 00000100:00100000:3.0:1789708704.645086:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 119 00000100:00100000:3.0:1789708704.645092:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a141080b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+59:10533:x1876645415800448:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708704.645111:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708704.645126:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866971 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d49ba expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.645184:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866971 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49ba expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.645194:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866971 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49ba expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.645208:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1411b4af00) 00010000:00010000:3.0:1789708704.645210:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789708704.645212:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38600, rc 0) 00000100:00100000:3.0:1789708704.645269:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a141080b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+60:10533:x1876645415800448:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 176us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708704.645276:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 119 00010000:00010000:1.0:1789708704.646422:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686696a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.646432:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686696a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.646437:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686696a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.646441:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708704.646444:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686696a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.646449:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686696a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.646460:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1411b4af00) 00010000:00010000:1.0:1789708704.646462:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789708704.646464:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686696a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.646468:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c686696a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708704.658119:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708704.660129:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415800576 00000100:00100000:3.0:1789708704.660143:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415800576 00000100:00100000:3.0:1789708704.660259:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:3.0:1789708704.660271:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a141080a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2363:x1876645415800576:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789708704.660618:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a141080a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+9:2363:x1876645415800576:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 348us (2505us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789708704.660628:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00080000:1.0:1789708704.679714:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708704.695705:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708704.696200:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415800832 00000100:00100000:1.0:1789708704.696226:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415800832 00000100:00100000:1.0:1789708704.696349:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:1.0:1789708704.696360:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+59:10533:x1876645415800832:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789708704.697907:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+60:10533:x1876645415800832:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 1540us (2203us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789708704.697921:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:2.0:1789708704.711762:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708704.711856:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415801088 00000100:00100000:3.0:1789708704.711866:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415801088 00000100:00100000:3.0:1789708704.711950:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 120 00000100:00100000:3.0:1789708704.711960:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+60:10533:x1876645415801088:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789708704.712083:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+60:10533:x1876645415801088:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 124us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708704.712091:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 120 00000100:00100000:2.0:1789708704.724904:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708704.725117:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415801216 00000100:00100000:3.0:1789708704.725131:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415801216 00000100:00100000:3.0:1789708704.725220:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 121 00000100:00100000:3.0:1789708704.725230:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+60:10533:x1876645415801216:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708704.725257:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708704.725283:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866978 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d49c1 expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.725356:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c686697f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.725371:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c686697f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.725383:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c686697f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708704.725714:0:7140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789708704.725737:0:7140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c686697f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.725766:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866978 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49c1 expref: 62 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.725783:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c686697f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49c1 expref: 61 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.725792:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1411b4af00) 00010000:00010000:3.0:1789708704.725795:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789708704.725799:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38c00, rc 0) 00000100:00100000:3.0:1789708704.726028:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+61:10533:x1876645415801216:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 798us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708704.726037:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 121 00000100:00100000:2.0:1789708704.738819:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708704.739598:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415801344 00000100:00100000:1.0:1789708704.739609:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415801344 00000100:00100000:1.0:1789708704.739714:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 38 00000100:00100000:1.0:1789708704.739725:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+9:2361:x1876645415801344:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708704.739744:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708704.739766:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6866986 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d49c8 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789708704.739794:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aacc9a1, blocks: 0x1 00010000:00010000:1.0:1789708704.739815:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=270s v=(0 0) 00010000:00010000:1.0:1789708704.739819:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708704.739828:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6866986 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49c8 expref: 10 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.739849:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6866986 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49c8 expref: 10 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.739865:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4400, rc 0) 00000100:00100000:1.0:1789708704.740257:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+10:2361:x1876645415801344:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 531us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708704.740266:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 38 00000100:00100000:0.0:1789708704.752702:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708704.753140:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415801600 00000100:00100000:1.0:1789708704.753153:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415801600 00000100:00100000:1.0:1789708704.753256:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 122 00000100:00100000:1.0:1789708704.753269:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+61:10533:x1876645415801600:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789708704.753391:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+61:10533:x1876645415801600:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 124us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708704.753407:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 122 00000100:00100000:2.0:1789708704.761076:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708704.761360:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415801728 00000100:00100000:3.0:1789708704.761371:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415801728 00000100:00100000:3.0:1789708704.761442:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:3.0:1789708704.761462:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+10:10533:x1876645415801728:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708704.761485:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708704.761506:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030b66fa8/0xa8f741d1c686698d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d49cf expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.761541:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6866986 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49c8 expref: 11 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.761570:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708704.761575:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708704.761580:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030b66fa8/0xa8f741d1c686698d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49cf expref: 11 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.761618:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6866986 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49c8 expref: 11 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.761633:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6866986 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49c8 expref: 11 pid: 6670 timeout: 370 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708704.761688:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f53ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6673:1876645426289792:192.168.202.53@tcp:104: 00000100:00100000:3.0:1789708704.761778:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140994ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708704.770792:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708704.771132:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415801856 00000100:00100000:1.0:1789708704.771145:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415801856 00010000:00010000:1.0:1789708704.771317:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6866986 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49c8 expref: 12 pid: 6670 timeout: 370 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708704.771363:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:1.0:1789708704.771374:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1407f54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+12:2361:x1876645415801856:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708704.771390:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708704.771423:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6866986 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49c8 expref: 12 pid: 6670 timeout: 370 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.771438:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6866986 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49c8 expref: 12 pid: 6670 timeout: 370 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.771577:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708704.771582:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708704.771592:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030b66fa8/0xa8f741d1c686698d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49cf expref: 12 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.771603:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030b66fa8/0xa8f741d1c686698d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49cf expref: 12 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.771687:0:5804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000030b66fa8/0xa8f741d1c686698d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49cf expref: 12 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708704.771700:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f48ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5804:1876645426289920:192.168.202.53@tcp:105: 00000100:00100000:1.0:1789708704.771831:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140319fcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1789708704.771947:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6866986 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49c8 expref: 12 pid: 6670 timeout: 370 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708704.771963:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f53ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6673:1876645426289792:192.168.202.53@tcp:104: 00010000:00010000:3.0:1789708704.771986:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030b66fa8/0xa8f741d1c686698d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49cf expref: 11 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.771997:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38200, rc 0) 00000100:00100000:3.0:1789708704.772026:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+11:10533:x1876645415801728:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 10576us (10962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708704.772044:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:1.0:1789708704.802851:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708704.803452:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415801984 00000100:00100000:0.0:1789708704.803472:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415801984 00002000:00100000:0.0:1789708704.803530:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8a143f48f800 x1876645415801984/t0(0) o4->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:90/0 lens 504/0 e 0 to 0 dl 1789708715 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789708704.803541:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a143f48f800 with x1876645415801984 ext(0->12) 00002000:00010000:0.0:1789708704.803546:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a143f48f800 00000100:00100000:0.0:1789708704.803582:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:0.0:1789708704.803594:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+11:2362:x1876645415801984:12345-192.168.202.53@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789708704.804346:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+13:2362:x1876645415801984:12345-192.168.202.53@tcp:4:lhsmtool_posix.0 Request processed in 753us (1502us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789708704.804360:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 2 00002000:00100000:0.0:1789708704.804368:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8a143f48f800 x1876645415801984/t4294967308(0) o4->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:90/0 lens 504/448 e 0 to 0 dl 1789708715 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789708704.804378:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a143f48f800 with x1876645415801984 ext(0->12) 00002000:00010000:0.0:1789708704.804382:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a143f48f800 00000100:00100000:2.0:1789708704.804762:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f48ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5804:1876645426289920:192.168.202.53@tcp:105: 00010000:00010000:2.0:1789708704.804784:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708704.804808:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1407f54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+12:2361:x1876645415801856:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 33437us (34028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708704.804822:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:0.0:1789708704.818520:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708704.818725:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415802112 00000100:00100000:1.0:1789708704.818736:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415802112 00000100:00100000:1.0:1789708704.818804:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 123 00000100:00100000:1.0:1789708704.818814:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1410808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+61:10533:x1876645415802112:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789708704.869552:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967395 is committed 00000001:00080000:0.0:1789708704.869578:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1789708704.869588:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1789708704.869615:0:5841:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a140390d300 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789708704.869620:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1426cb6c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a140390d780 00000020:00080000:0.0:1789708704.869624:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1426cb6b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a1308e2c400 00000004:00080000:0.0:1789708704.869673:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1789708704.869712:0:5841:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a140307f6c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789708704.869716:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a143f515800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a140307f480 00000020:00080000:0.0:1789708704.869718:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a143f515a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a140e31a000 00000004:00080000:0.0:1789708704.869740:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789708704.869760:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1789708704.869973:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789708704.870159:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f53c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426290176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789708704.870240:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708704.870302:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789708704.870309:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f53ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426290048:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789708704.870333:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708704.870363:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426290176 00000100:00100000:3.0:1789708704.870372:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426290176 00000100:00100000:3.0:1789708704.870422:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426290048 00000100:00100000:3.0:1789708704.870426:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426290048 00000100:00100000:3.0:1789708704.870447:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789708704.870456:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3287:x1876645426290176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789708704.870597:0:6670:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789708704.870601:0:6670:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789708705 00002000:00010000:3.0:1789708704.870603:0:6670:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789708704.870605:0:6670:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789708705 -> 1789708705 00002000:00010000:3.0:1789708704.870608:0:6670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789708704.870681:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3287:x1876645426290176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 226us (441us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789708704.870689:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789708704.870707:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789708704.870715:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3287:x1876645426290048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789708704.870729:0:6670:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1789708704.870747:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c576da8f/0xa8f741d1c6866994 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.870786:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c6866756 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d492e expref: 11 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.870795:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789708704.870799:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789708704.870802:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c576da8f/0xa8f741d1c6866994 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.870828:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c6866756 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d492e expref: 11 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.870843:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c6866756 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d492e expref: 11 pid: 6673 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708704.870853:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f53ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1876645426290304:192.168.202.53@tcp:104: 00000100:00100000:3.0:1789708704.870912:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140994a840 going to sleep for 11 seconds 00000100:00080000:3.0:1789708704.870924:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789708704.874757:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a143f53c000/2, rc 0, transno 4294967309 00000100:00100000:3.0:1789708704.874772:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f53c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426290176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789708704.875079:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708704.875284:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f53ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1876645426290304:192.168.202.53@tcp:104: 00010000:00010000:3.0:1789708704.875309:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c576da8f/0xa8f741d1c6866994 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708704.875515:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1410808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+15:10533:x1876645415802112:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 Request processed in 56701us (57002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708704.875526:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 123 00000100:00100000:3.0:1789708704.878341:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708704.879251:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415802368 00000100:00100000:0.0:1789708704.879264:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415802368 00000100:00100000:0.0:1789708704.879336:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:0.0:1789708704.879347:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+12:2361:x1876645415802368:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789708704.880611:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415802240 00000100:00100000:2.0:1789708704.880619:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415802240 00010000:00010000:2.0:1789708704.880667:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c6866756 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d492e expref: 13 pid: 6673 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708704.880698:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:2.0:1789708704.880707:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427033800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+13:2362:x1876645415802240:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708704.880718:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708704.880724:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c6866756 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d492e expref: 13 pid: 6673 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.880739:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c6866756 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d492e expref: 13 pid: 6673 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.880761:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c6866756 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d492e expref: 13 pid: 6673 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.880776:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708704.880780:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708704.880786:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c576da8f/0xa8f741d1c6866994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.880794:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c576da8f/0xa8f741d1c6866994 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.880833:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708704.880890:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427033800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+12:2362:x1876645415802240:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 183us (5813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708704.880897:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:0.0:1789708704.881082:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a140366ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426290432:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789708704.881152:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708704.881963:0:6673:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789708704.881976:0:6673:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:2.0:1789708704.882750:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c576da8f/0xa8f741d1c6866994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.882766:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c576da8f/0xa8f741d1c6866994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.882778:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c576da8f/0xa8f741d1c6866994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.882786:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c576da8f/0xa8f741d1c6866994 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.882805:0:6670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789708704.883926:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3287:x1876645426290048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13205us (13585us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789708704.884020:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789708704.884050:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426290432 00000100:00100000:2.0:1789708704.884059:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426290432 00000100:00100000:2.0:1789708704.884362:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789708704.884374:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3288:x1876645426290432:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789708704.884579:0:6670:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1789708704.884614:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aacc99f, atime: 0x6aacc99f, ctime: 0x6aacc99f, blocks: 0x1 00010000:00010000:2.0:1789708704.884621:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686699b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.884636:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=270s v=(0 0) 00010000:00010000:2.0:1789708704.884640:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708704.884646:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686699b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.884687:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686699b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.884697:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686699b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.884705:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686699b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.884720:0:6670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789708704.884980:0:8434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708704.884988:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c576da8f/0xa8f741d1c6866994 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.884997:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14013a0200 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708704.885002:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c576da8f/0xa8f741d1c6866994 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.885012:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c576da8f/0xa8f741d1c6866994 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.885040:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c576da8f/0xa8f741d1c6866994 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.885049:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c576da8f/0xa8f741d1c6866994 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.885073:0:8434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708704.885077:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686699b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.885095:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6be00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708704.885099:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686699b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.885121:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686699b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.885135:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686699b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.885141:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c686699b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.885156:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708704.885157:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708704.885159:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789708704.885830:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789708704.885882:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a143f53ed80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789708704.885891:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f53ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426290048:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789708704.888778:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3288:x1876645426290432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4401us (7619us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789708704.888793:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1789708704.888822:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789708704.890090:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a140366ea00/2, rc 0, transno 4294967304 00000100:00100000:0.0:1789708704.890102:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a140366ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426290432:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789708704.892851:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789708704.915529:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1789708704.915553:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1789708704.915560:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1789708704.915955:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415802368:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 Request processed in 36604us (37618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708704.915968:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:1.0:1789708704.919769:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708704.919887:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415802624 00000100:00100000:3.0:1789708704.919900:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415802624 00000100:00100000:3.0:1789708704.920009:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 124 00000100:00100000:3.0:1789708704.920020:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+15:10533:x1876645415802624:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789708704.920083:0:7140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708704.920242:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c686697f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49c1 expref: 15 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.920263:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1411b4af00) 00010000:00010000:3.0:1789708704.920269:0:7140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708704.920304:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c68669a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.920319:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c68669a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.920328:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c68669a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708704.920646:0:7140:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000305b179b reply state 00000000b219ef53 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c68669a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708704.920786:0:7140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789708704.920894:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+16:10533:x1876645415802624:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 875us (1132us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789708704.920902:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 124 00010000:00010000:3.0:1789708704.923622:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c68669a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.923639:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c68669a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.923646:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c68669a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.923680:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14013a1e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708704.923685:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c68669a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.923693:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c68669a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.923710:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1411b4af00) 00010000:00010000:3.0:1789708704.923713:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708704.923718:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c68669a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.923724:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c68669a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708704.929327:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708704.929637:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415802752 00000100:00100000:0.0:1789708704.929678:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415802752 00000100:00100000:0.0:1789708704.929742:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:0.0:1789708704.929753:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2362:x1876645415802752:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789708704.929975:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789708704.929979:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789708705 -> 1789708704 00002000:00010000:0.0:1789708704.929982:0:6672:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789708703 00002000:00010000:0.0:1789708704.929985:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789708705 -> 1789708704 00002000:00010000:0.0:1789708704.929987:0:6672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789708704.930052:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2362:x1876645415802752:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 301us (734us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789708704.930077:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:0.0:1789708704.938373:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708704.938600:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415803008 00000100:00100000:3.0:1789708704.938611:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415803008 00000100:00100000:3.0:1789708704.938711:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 125 00000100:00100000:3.0:1789708704.938722:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+15:10533:x1876645415803008:12345-192.168.202.53@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789708704.938796:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c68669a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.938813:0:11601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866963 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49b3 expref: 15 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.938841:0:11601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c68669a9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.938877:0:11601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49b3 expref: 15 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.938890:0:11601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866963 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49b3 expref: 15 pid: 11601 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708704.938904:0:11601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f53f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11601:1876645426290560:192.168.202.53@tcp:104: 00000100:00100000:2.0:1789708704.946154:0:11601:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140994a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789708704.951597:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708704.951683:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415803136 00000100:00100000:3.0:1789708704.951693:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415803136 00010000:00010000:3.0:1789708704.951732:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866963 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49b3 expref: 16 pid: 11601 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708704.951779:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:3.0:1789708704.951789:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+16:2362:x1876645415803136:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708704.951806:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708704.951813:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866963 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49b3 expref: 16 pid: 11601 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.951827:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866963 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49b3 expref: 16 pid: 11601 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.951848:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1411b4af00) 00010000:00010000:3.0:1789708704.951854:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c68669a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.951876:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c68669a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.951884:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c68669a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.951904:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708704.951977:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+16:2362:x1876645415803136:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 188us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708704.951985:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 55 00010000:00010000:0.0:1789708704.953799:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866963 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49b3 expref: 15 pid: 11601 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708704.953823:0:11601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f53f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11601:1876645426290560:192.168.202.53@tcp:104: 00010000:00010000:0.0:1789708704.953847:0:11601:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c68669a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.953856:0:11601:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c68669a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.953863:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c68669a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.953894:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c68669a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.953901:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c68669a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.953907:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c68669a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.953913:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14013a1c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708704.953917:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c68669a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.953926:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c68669a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.953970:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1411b4af00) 00010000:00010000:0.0:1789708704.953973:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789708704.953979:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c68669a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.953985:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c68669a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708704.954129:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+14:10533:x1876645415803008:12345-192.168.202.53@tcp:55:lhsmtool_posix.0 Request processed in 15407us (15764us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789708704.954139:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 125 00000100:00100000:2.0:1789708704.957153:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708704.957364:0:11993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415803264 00000100:00100000:0.0:1789708704.957375:0:11993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415803264 00000100:00100000:0.0:1789708704.957524:0:11993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:0.0:1789708704.957536:0:11993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2361:x1876645415803264:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789708704.957587:0:11993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c68669b0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.957608:0:11993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030b66fa8/0xa8f741d1c686698d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49cf expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.957617:0:11993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708704.957621:0:11993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789708704.957625:0:11993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c68669b0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.957802:0:11993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030b66fa8/0xa8f741d1c686698d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49cf expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708704.957830:0:11993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030b66fa8/0xa8f741d1c686698d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49cf expref: 7 pid: 6673 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708704.957844:0:11993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427033100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11993:1876645426290688:192.168.202.53@tcp:104: 00000100:00100000:0.0:1789708704.957970:0:11993:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708704.961593:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708704.961703:0:11993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427033100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11993:1876645426290688:192.168.202.53@tcp:104: 00010000:00010000:0.0:1789708704.961729:0:11993:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c68669b0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708704.961821:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415803392 00000100:00100000:2.0:1789708704.961831:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415803392 00010000:00010000:2.0:1789708704.961868:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030b66fa8/0xa8f741d1c686698d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49cf expref: 8 pid: 6673 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708704.961909:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:2.0:1789708704.961919:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2361:x1876645415803392:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708704.961945:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708704.961968:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030b66fa8/0xa8f741d1c686698d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49cf expref: 8 pid: 6673 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.961981:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030b66fa8/0xa8f741d1c686698d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49cf expref: 8 pid: 6673 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.962004:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030b66fa8/0xa8f741d1c686698d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49cf expref: 8 pid: 6673 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.962019:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708704.962023:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708704.962029:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c68669b0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.962038:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c68669b0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.962089:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708704.962147:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2361:x1876645415803392:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 229us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708704.962155:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 56 00010000:00010000:3.0:1789708704.962412:0:11993:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c68669b0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.962422:0:11993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c68669b0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.962448:0:11993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c68669b0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.962458:0:11993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c68669b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.962466:0:11993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c68669b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.962473:0:11993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23600 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708704.962477:0:11993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c68669b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.962495:0:11993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c68669b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.962508:0:11993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c68669b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.962517:0:11993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c68669b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708704.962571:0:11993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415803264:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 Request processed in 5038us (5427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708704.962580:0:11993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:1.0:1789708704.965769:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708704.966456:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415803648 00000100:00100000:2.0:1789708704.966467:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415803648 00000100:00100000:2.0:1789708704.966574:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 126 00000100:00100000:2.0:1789708704.966584:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+14:10533:x1876645415803648:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789708704.966708:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68669b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.966726:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68669b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.966738:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68669b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.966970:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68669be lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.966982:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866971 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49ba expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.966991:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68669be lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.967028:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866971 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49ba expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.967062:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866971 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49ba expref: 15 pid: 5821 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708704.967077:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a140366e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1876645426290816:192.168.202.53@tcp:104: 00000100:00100000:2.0:1789708704.967863:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405876e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708704.971754:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708704.971857:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a140366e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1876645426290816:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708704.971887:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68669be lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708704.971960:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415803776 00000100:00100000:1.0:1789708704.971970:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415803776 00010000:00010000:1.0:1789708704.972014:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866971 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49ba expref: 16 pid: 5821 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708704.972077:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:1.0:1789708704.972099:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+16:2361:x1876645415803776:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708704.972117:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708704.972125:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866971 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49ba expref: 16 pid: 5821 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.972139:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866971 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49ba expref: 16 pid: 5821 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.972175:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866971 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49ba expref: 16 pid: 5821 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.972192:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1411b4af00) 00010000:00010000:1.0:1789708704.972197:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68669be lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.972207:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68669be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.972214:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68669be lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708704.972247:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708704.972315:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+15:2361:x1876645415803776:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 228us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708704.972322:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 57 00010000:00010000:3.0:1789708704.973004:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68669be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708704.973014:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68669be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789708704.973395:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1789708704.973635:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1789708704.975992:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1789708704.976349:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a140366e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5820:1876645426290944:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789708704.976526:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708704.976617:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140390dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708704.976749:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426290944 00000100:00100000:1.0:1789708704.976763:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426290944 00000100:00100000:1.0:1789708704.976865:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789708704.976876:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5820:x1876645426290944:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789708704.976982:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5820:x1876645426290944:12345-0@lo:1000:mdt00_001.0 Request processed in 107us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708704.976990:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789708704.977058:0:5820:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1789708704.977064:0:5820:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1789708704.977101:0:5820:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a143f53c000, transno 4294967309 00000100:00100000:2.0:1789708704.977123:0:5820:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a143f53ed80 x1876645426290048/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789708720 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708704.977136:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a140366e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5820:1876645426290944:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789708704.977645:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1789708704.977750:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a140366e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5820:1876645426291072:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789708704.977794:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708704.984625:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308463900 going to sleep for 11 seconds 00000100:00100000:0.0:1789708704.989392:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426291072 00000100:00100000:0.0:1789708704.989422:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426291072 00000100:00100000:0.0:1789708704.989820:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708704.989831:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5820:x1876645426291072:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789708704.991874:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5820:x1876645426291072:12345-0@lo:1000:mdt00_001.0 Request processed in 2036us (14070us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789708704.991888:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789708704.995759:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a140366e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5820:1876645426291072:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789708704.995841:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68669be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.995853:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68669be lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.995861:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68669be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.995868:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708704.995872:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68669be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.995880:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68669be lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.995895:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a1411b4af00) 00010000:00010000:2.0:1789708704.995898:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789708704.995903:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68669be lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.995908:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c68669be lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.995953:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866901 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.995960:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866901 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.995966:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866901 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.995980:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708704.995983:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866901 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.995989:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866901 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.995999:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:2.0:1789708704.996001:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789708704.996009:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c6866908 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d499e expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.996020:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c6866908 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d499e expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.996028:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c6866908 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d499e expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708704.996073:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c6866908 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d499e expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708704.996090:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a140366c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1876645426291200:192.168.202.53@tcp:105: 00000100:00100000:2.0:1789708704.996256:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405876e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708705.001507:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708705.002215:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a140366c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1876645426291200:192.168.202.53@tcp:105: 00010000:00010000:0.0:1789708705.002250:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866901 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.002260:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866901 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.002310:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c68669c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.002338:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c68669c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.002350:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c68669c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.002363:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c68669c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.002369:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c68669c5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.002376:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c68669c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.002382:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708705.002387:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c68669c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.002405:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c68669c5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.002419:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:0.0:1789708705.002422:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708705.002426:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c68669c5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.002432:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c68669c5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.002442:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68669b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.002468:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68669b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.002475:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68669b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.002481:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6ba00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708705.002484:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68669b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.002490:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68669b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.002500:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:0.0:1789708705.002502:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789708705.002505:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68669b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.002511:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c68669b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708705.002814:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+18:10533:x1876645415803648:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 36228us (37163us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1789708705.002825:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 126 00000020:00080000:0.0:1789708705.002832:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789708705.003310:0:11657:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789708705.003315:0:11657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789708705.003764:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789708705.003790:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789708705.010102:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415803904 00000100:00100000:3.0:1789708705.010119:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415803904 00000100:00100000:2.0:1789708705.010493:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:2.0:1789708705.010504:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+18:10532:x1876645415803904:12345-192.168.202.53@tcp:49:lfs.0 00000100:00100000:2.0:1789708705.022131:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+18:10532:x1876645415803904:12345-192.168.202.53@tcp:49:lfs.0 Request processed in 11616us (20621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708705.022149:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:3.0:1789708705.023333:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708705.023753:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415804160 00000100:00100000:1.0:1789708705.023762:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415804160 00000100:00100000:1.0:1789708705.023822:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:1.0:1789708705.023834:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14069fbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+18:10533:x1876645415804160:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789708705.024741:0:5823:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789708705.024852:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1789708705.024905:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68669cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.024921:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68669cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.025927:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68669cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.026068:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68669cc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.026075:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68669cc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.026082:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68669cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.027646:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789708705.027805:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14069fbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+20:10533:x1876645415804160:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 3969us (4472us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789708705.027815:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 32 00000020:00080000:1.0:1789708705.027821:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789708705.028450:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708705.028472:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68669cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708705.028481:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5000 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:2.0:1789708705.028484:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68669cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708705.028494:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68669cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708705.028509:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a14033c4a00) 00010000:00010000:2.0:1789708705.028512:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789708705.028517:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68669cc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708705.028524:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68669cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708705.028543:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708705.028545:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708705.028547:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708705.033253:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708705.033761:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415804416 00000100:00100000:3.0:1789708705.033773:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415804416 00000100:00100000:3.0:1789708705.033827:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 127 00000100:00100000:3.0:1789708705.033850:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+20:10532:x1876645415804416:12345-192.168.202.53@tcp:58:lfs.0 00000040:00080000:3.0:1789708705.034130:0:7140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789708705.034858:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+20:10532:x1876645415804416:12345-192.168.202.53@tcp:58:lfs.0 Request processed in 1004us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708705.034867:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 127 00000100:00100000:1.0:1789708705.124754:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708705.124850:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415804544 00000100:00100000:0.0:1789708705.124861:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415804544 00000100:00100000:0.0:1789708705.124921:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 128 00000100:00100000:0.0:1789708705.124960:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+20:10535:x1876645415804544:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1789708705.125002:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708705.125023:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c68669d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d49d6 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.125110:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c68669da lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.125124:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c68669da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.125135:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c68669da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.125151:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c68669e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.125158:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c68669e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.125177:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c68669e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.125430:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22200/0xa8f741d1c68669e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.125442:0:11601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4997 expref: 21 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.125450:0:11601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22200/0xa8f741d1c68669e8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.125487:0:11601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4997 expref: 21 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.125512:0:11601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4997 expref: 21 pid: 7140 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708705.125527:0:11601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427031880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11601:1876645426291328:192.168.202.53@tcp:104: 00000100:00100000:0.0:1789708705.125753:0:11601:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708705.131315:0:11601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427031880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11601:1876645426291328:192.168.202.53@tcp:104: 00010000:00010000:0.0:1789708705.131346:0:11601:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22200/0xa8f741d1c68669e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708705.138822:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708705.141098:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415804800 00000100:00100000:2.0:1789708705.141115:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415804800 00000100:00100000:2.0:1789708705.141218:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:2.0:1789708705.141229:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+22:5592:x1876645415804800:12345-192.168.202.53@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789708705.141518:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+23:5592:x1876645415804800:12345-192.168.202.53@tcp:35:ldlm_bl.0 Request processed in 290us (2704us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1789708705.141526:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:2.0:1789708705.145757:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708705.145864:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415804928 00000100:00100000:0.0:1789708705.145875:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415804928 00010000:00010000:0.0:1789708705.145917:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4997 expref: 23 pid: 7140 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708705.145977:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00100000:0.0:1789708705.145987:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+23:2362:x1876645415804928:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708705.146006:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708705.146014:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4997 expref: 23 pid: 7140 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.146029:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4997 expref: 23 pid: 7140 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.146052:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68668f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4997 expref: 23 pid: 7140 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.146101:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:0.0:1789708705.146107:0:8435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22200/0xa8f741d1c68669e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.146119:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22200/0xa8f741d1c68669e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.146128:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22200/0xa8f741d1c68669e8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708705.146552:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708705.146619:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+22:2362:x1876645415804928:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 632us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708705.146629:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 58 00010000:00010000:1.0:1789708705.153150:0:11601:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22200/0xa8f741d1c68669e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153182:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22200/0xa8f741d1c68669e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708705.153235:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789708705.153239:0:11601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789708705.153273:0:11601:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22200/0xa8f741d1c68669e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153289:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22200/0xa8f741d1c68669e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153300:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c68669da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153306:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c68669da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153313:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c68669da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153319:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708705.153323:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c68669da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153353:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c68669da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153369:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:1.0:1789708705.153372:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708705.153377:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c68669da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153382:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c68669da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153412:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c68669e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153419:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c68669e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153426:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c68669e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153431:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708705.153433:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c68669e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153440:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c68669e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153447:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a14148f3600) 00010000:00010000:1.0:1789708705.153450:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708705.153558:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c68669e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153576:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c68669e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153621:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c68669d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49d6 expref: 22 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153635:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22200/0xa8f741d1c68669e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49d6 expref: 21 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708705.153642:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:1.0:1789708705.153644:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708705.153647:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d22200, rc 0) 00000100:00100000:1.0:1789708705.153982:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+21:10535:x1876645415804544:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 29050us (29236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708705.153992:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 128 00010000:00010000:0.0:1789708705.914879:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789708706.017776:0:12031:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789708706.017786:0:12031:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708706.017843:0:12031:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789708706.017856:0:12031:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789708706.043964:0:11657:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789708706.043973:0:11657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789708706.044021:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789708706.044032:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789708706.044168:0:11657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427031880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11657:1876645426291456:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789708706.044269:0:11657:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708706.044557:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708706.044581:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708706.044606:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708706.044627:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708706.044665:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415805056 00000100:00100000:2.0:1789708706.044672:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415805056 00000100:00100000:2.0:1789708706.044711:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 269 00000100:00100000:2.0:1789708706.044720:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2361:x1876645415805056:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708706.044767:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2361:x1876645415805056:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 47us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708706.044774:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 269 00000100:00100000:1.0:1789708706.047330:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415805184 00000100:00100000:1.0:1789708706.047343:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415805184 00000100:00100000:1.0:1789708706.047418:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415805312 00000100:00100000:1.0:1789708706.047421:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415805312 00000100:00100000:1.0:1789708706.047450:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:1.0:1789708706.047461:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2361:x1876645415805184:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708706.047527:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2361:x1876645415805184:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 68us (2971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708706.047550:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:1.0:1789708706.047569:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:1.0:1789708706.047575:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415805312:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708706.047598:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415805312:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (2971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708706.047604:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:1.0:1789708706.047677:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415805440 00000100:00100000:1.0:1789708706.047681:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415805440 00000100:00100000:1.0:1789708706.047715:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 94 00000100:00100000:1.0:1789708706.047721:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c9d2a103-cf70-4470-bdd0-387470668318+5:2361:x1876645415805440:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708706.047759:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c9d2a103-cf70-4470-bdd0-387470668318+5:2361:x1876645415805440:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 38us (3176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708706.047766:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 94 00000100:00080000:3.0:1789708706.049938:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789708706.049949:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789708706.049952:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708706.056638:0:11657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427031880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11657:1876645426291456:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789708706.068326:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708706.069311:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415805568 00000100:00100000:3.0:1789708706.069323:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415805568 00000100:00100000:3.0:1789708706.069408:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 129 00000100:00100000:3.0:1789708706.069418:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+21:10546:x1876645415805568:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789708706.069453:0:7140:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789708706.069553:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+21:10546:x1876645415805568:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 136us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708706.069561:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 129 00000100:00080000:3.0:1789708706.069583:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708706.076591:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708706.077613:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415805824 00000100:00100000:1.0:1789708706.077625:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415805824 00000100:00100000:1.0:1789708706.077715:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 130 00000100:00100000:1.0:1789708706.077726:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+21:10546:x1876645415805824:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708706.077758:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708706.077779:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c68669ef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d49dd expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708706.077881:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c68669f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708706.078504:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c68669f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708706.078516:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c68669f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708706.078530:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789708706.078678:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c68669ef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49dd expref: 24 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708706.078698:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c68669f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49dd expref: 23 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708706.078706:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:1.0:1789708706.078709:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708706.078712:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4600, rc 0) 00000100:00100000:1.0:1789708706.080505:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+23:10546:x1876645415805824:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 2771us (3915us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789708706.080517:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 130 00000100:00100000:0.0:1789708706.115606:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708706.115718:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708706.115799:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415806080 00000100:00100000:1.0:1789708706.115809:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415806080 00000100:00100000:1.0:1789708706.115868:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 131 00000100:00100000:1.0:1789708706.115877:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+23:10546:x1876645415806080:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789708706.115964:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866a04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708706.115982:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866a04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708706.116008:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866a04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708706.116204:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866a04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708706.116212:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866a04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708706.116219:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866a04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708706.116226:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708706.116230:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866a04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708706.116238:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866a04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708706.116251:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:1.0:1789708706.116254:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789708706.116258:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866a04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708706.116264:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866a04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708706.116404:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+24:10546:x1876645415806080:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 527us (808us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789708706.116413:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 131 00000100:00100000:1.0:1789708706.116446:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415806208 00000100:00100000:1.0:1789708706.116450:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415806208 00000100:00100000:1.0:1789708706.116483:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:1.0:1789708706.116490:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427031880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+24:2363:x1876645415806208:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708706.116503:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708706.116517:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c68669f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49dd expref: 24 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708706.116526:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:1.0:1789708706.116530:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708706.116548:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427031880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+23:2363:x1876645415806208:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 59us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708706.116556:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000040:00080000:1.0:1789708706.116697:0:11657:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789708706.116701:0:11657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708706.117127:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789708706.117143:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789708706.124206:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708706.124241:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415806464 00000100:00100000:2.0:1789708706.124250:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415806464 00000100:00100000:2.0:1789708706.124302:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:2.0:1789708706.124313:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+23:10546:x1876645415806464:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789708706.124552:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+24:10546:x1876645415806464:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 240us (351us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789708706.124572:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 34 00010000:00010000:2.0:1789708706.939496:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708707.068758:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708707.068783:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f53d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426291584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708707.069220:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708707.070059:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426291584 00000100:00100000:3.0:1789708707.070073:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426291584 00000100:00080000:0.0:1789708707.070269:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708707.070545:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789708707.070556:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1876645426291584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789708707.070606:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708707.070701:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1876645426291584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708707.070710:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789708707.070797:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f53d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426291584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708707.579226:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426291712:0@lo:400:kworker.0 00000100:00100000:0.0:1789708707.579297:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708707.579343:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876645426292224:0@lo:400:kworker.0 00000100:00100000:0.0:1789708707.579368:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708707.579399:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789708707.579404:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426291840:0@lo:400:kworker.0 00000100:00100000:0.0:1789708707.579423:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708707.579439:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426292352:0@lo:400:kworker.0 00000100:00100000:0.0:1789708707.579459:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708707.579484:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426291968:0@lo:400:kworker.0 00000100:00100000:0.0:1789708707.579507:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708707.579525:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708707.579531:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426292096:0@lo:400:kworker.0 00000100:00100000:0.0:1789708707.579554:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708707.579584:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426291712 00000100:00100000:0.0:1789708707.579592:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426291712 00000100:00100000:0.0:1789708707.579636:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789708707.579645:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3286:x1876645426291712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708707.579725:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3286:x1876645426291712:12345-0@lo:400:kworker.0 Request processed in 80us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708707.579732:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789708707.579762:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426292224 00000100:00100000:0.0:1789708707.579765:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426292224 00000100:00100000:0.0:1789708707.579796:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426291840 00000100:00100000:0.0:1789708707.579799:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426291840 00000100:00100000:0.0:1789708707.579831:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426291968 00000100:00100000:0.0:1789708707.579834:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426291968 00000100:00100000:0.0:1789708707.579851:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789708707.579857:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876645426292224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708707.579889:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876645426292224:12345-0@lo:400:kworker.0 Request processed in 32us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708707.579895:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789708707.580144:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789708707.580154:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426291840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708707.580187:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426291840:12345-0@lo:400:kworker.0 Request processed in 35us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708707.580193:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789708707.580208:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789708707.580213:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426291968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708707.580246:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426291968:12345-0@lo:400:kworker.0 Request processed in 33us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708707.580252:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789708707.580275:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426292352 00000100:00100000:0.0:1789708707.580278:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426292352 00000100:00100000:0.0:1789708707.580305:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426292096 00000100:00100000:0.0:1789708707.580308:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426292096 00000100:00100000:0.0:1789708707.580328:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789708707.580334:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3286:x1876645426292352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708707.580367:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3286:x1876645426292352:12345-0@lo:400:kworker.0 Request processed in 33us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708707.580379:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789708707.580390:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789708707.580403:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3288:x1876645426292096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708707.580436:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3288:x1876645426292096:12345-0@lo:400:kworker.0 Request processed in 33us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708707.580441:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789708707.580461:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789708707.580464:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708707.580503:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426292096:0@lo:400:kworker.0 00000100:00100000:0.0:1789708707.580513:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426291968:0@lo:400:kworker.0 00000100:00100000:0.0:1789708707.580539:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426291840:0@lo:400:kworker.0 00000100:00100000:0.0:1789708707.580548:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426292352:0@lo:400:kworker.0 00000100:00100000:0.0:1789708707.580555:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426291712:0@lo:400:kworker.0 00000100:00100000:0.0:1789708707.580563:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876645426292224:0@lo:400:kworker.0 00000100:00100000:0.0:1789708707.582243:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789708707.582273:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f53dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426292480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708707.582380:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708707.582555:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426292480 00000100:00100000:3.0:1789708707.582581:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426292480 00000100:00100000:3.0:1789708707.582978:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789708707.582996:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1876645426292480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789708707.583053:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708707.583125:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3289:x1876645426292480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708707.583133:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789708707.590514:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f53dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426292480:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789708707.963023:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789708708.275126:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1789708708.275334:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1789708708.275357:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:2.0:1789708708.989774:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789708709.242952:0:11657:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789708709.242964:0:11657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708709.243011:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789708709.243026:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789708709.856995:0:12083:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789708709.857006:0:12083:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789708709.857069:0:12083:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789708709.857083:0:12083:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789708710.021517:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708710.060772:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708710.060865:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415806720 00000100:00100000:0.0:1789708710.060876:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415806720 00000100:00100000:0.0:1789708710.060970:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 132 00000100:00100000:0.0:1789708710.060981:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+24:10568:x1876645415806720:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1789708710.061005:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708710.061026:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22400/0xa8f741d1c6866a0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d49e4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708710.061155:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23400/0xa8f741d1c6866a12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708710.061169:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23400/0xa8f741d1c6866a12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708710.061191:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23400/0xa8f741d1c6866a12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708710.061203:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00080000:1.0:1789708710.061335:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789708710.061504:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22400/0xa8f741d1c6866a0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49e4 expref: 27 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708710.061522:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23400/0xa8f741d1c6866a12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49e4 expref: 26 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708710.061530:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:0.0:1789708710.061533:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789708710.061537:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23400, rc 0) 00000100:00100000:0.0:1789708710.061909:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+26:10568:x1876645415806720:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 929us (1146us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789708710.061918:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 132 00000100:00100000:3.0:1789708710.066495:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708710.066588:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415806848 00000100:00100000:0.0:1789708710.066598:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415806848 00000100:00100000:2.0:1789708710.066820:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 133 00000100:00100000:2.0:1789708710.066832:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+26:10568:x1876645415806848:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:2.0:1789708710.066914:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708710.066932:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708710.066945:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708710.066974:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708710.066981:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708710.066988:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708710.066994:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708710.066998:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708710.067021:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708710.067034:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:2.0:1789708710.067037:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789708710.067041:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708710.067048:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708710.067274:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+26:10568:x1876645415806848:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 443us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708710.067282:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 133 00000001:00080000:3.0:1789708710.190769:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1789708710.190790:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1789708710.200007:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1789708710.200033:0:5841:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1789708710.200069:0:5841:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a1308463840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789708710.200074:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1405100600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a1308463cc0 00000020:00080000:1.0:1789708710.200077:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1405100400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a143e9e2800 00000020:00080000:0.0:1789708710.200148:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789708710.200306:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1789708710.234878:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708710.235238:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415806976 00000100:00100000:0.0:1789708710.235251:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415806976 00000100:00100000:0.0:1789708710.235441:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:0.0:1789708710.235453:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2362:x1876645415806976:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:0.0:1789708710.235473:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708710.235494:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e037ac67/0xa8f741d1c6866a27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d49eb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708710.235520:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aacc9a0, atime: 0x6aacc99f, ctime: 0x6aacc9a0, blocks: 0xb 00010000:00010000:0.0:1789708710.235540:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=276s v=(0 0) 00010000:00010000:0.0:1789708710.235544:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708710.235553:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e037ac67/0xa8f741d1c6866a27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49eb expref: 6 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708710.235571:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e037ac67/0xa8f741d1c6866a27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49eb expref: 6 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708710.235587:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d22400, rc 0) 00000100:00100000:0.0:1789708710.235724:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2362:x1876645415806976:12345-192.168.202.53@tcp:101:cat.0 Request processed in 273us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708710.235731:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00080000:1.0:1789708710.235791:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789708710.241194:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708710.241309:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415807104 00000100:00100000:0.0:1789708710.241320:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415807104 00002000:00100000:0.0:1789708710.241384:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8a143f53dc00 x1876645415807104/t0(0) o3->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:96/0 lens 488/0 e 0 to 0 dl 1789708721 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789708710.241395:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a143f53dc00 with x1876645415807104 ext(0->4095) 00002000:00010000:0.0:1789708710.241401:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a143f53dc00 00000100:00100000:0.0:1789708710.241435:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:0.0:1789708710.241459:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415807104:12345-192.168.202.53@tcp:3:cat.0 00000100:00100000:2.0:1789708710.242469:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415807104:12345-192.168.202.53@tcp:3:cat.0 Request processed in 1007us (1281us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789708710.242486:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 3 00002000:00100000:2.0:1789708710.242496:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8a143f53dc00 x1876645415807104/t0(0) o3->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:96/0 lens 488/4536 e 0 to 0 dl 1789708721 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789708710.242506:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a143f53dc00 with x1876645415807104 ext(0->4095) 00002000:00010000:2.0:1789708710.242511:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a143f53dc00 00010000:00010000:2.0:1789708711.036054:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708711.176543:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708711.176584:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708711.176612:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708711.176632:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708711.176668:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708711.176700:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415807616 00000100:00100000:0.0:1789708711.176709:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415807616 00000100:00100000:0.0:1789708711.176752:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415807488 00000100:00100000:0.0:1789708711.176754:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415807488 00000100:00100000:0.0:1789708711.176781:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:0.0:1789708711.176790:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2364:x1876645415807616:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708711.176855:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2364:x1876645415807616:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 66us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708711.176862:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:1.0:1789708711.177209:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415807360 00000100:00100000:1.0:1789708711.177214:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415807360 00000100:00100000:1.0:1789708711.177247:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415807744 00000100:00100000:1.0:1789708711.177249:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415807744 00000100:00100000:1.0:1789708711.177267:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 98 00000100:00100000:1.0:1789708711.177273:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+13:2363:x1876645415807360:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708711.177301:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+13:2363:x1876645415807360:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 29us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708711.177307:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 98 00000100:00100000:1.0:1789708711.177318:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 99 00000100:00100000:1.0:1789708711.177323:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c9d2a103-cf70-4470-bdd0-387470668318+5:2364:x1876645415807744:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708711.177350:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c9d2a103-cf70-4470-bdd0-387470668318+5:2364:x1876645415807744:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 27us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708711.177355:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 99 00000100:00100000:1.0:1789708711.177391:0:11993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:1.0:1789708711.177397:0:11993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2364:x1876645415807488:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708711.177417:0:11993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2364:x1876645415807488:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 21us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708711.177422:0:11993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:2.0:1789708711.177572:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415807232 00000100:00100000:2.0:1789708711.177575:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415807232 00000100:00100000:2.0:1789708711.177603:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 271 00000100:00100000:2.0:1789708711.177609:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2363:x1876645415807232:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708711.177644:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2363:x1876645415807232:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 36us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708711.177670:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 271 00000100:00080000:2.0:1789708711.179722:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789708711.179730:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708712.206051:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a140366ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426292608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789708712.206152:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708712.206228:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426292608 00000100:00100000:2.0:1789708712.206236:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426292608 00000100:00100000:2.0:1789708712.206288:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789708712.206298:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426292608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789708712.206454:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789708712.206505:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426292608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 208us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708712.206514:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1789708712.206535:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708712.206563:0:3289:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789708712.206568:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1789708712.206598:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a140366ea00, transno 4294967304 00000100:00100000:2.0:1789708712.206620:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a140366ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426292608:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789708712.375741:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708712.699121:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426292864:0@lo:400:kworker.0 00000100:00100000:2.0:1789708712.699122:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876645426293120:0@lo:400:kworker.0 00000100:00100000:3.0:1789708712.699208:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426292992:0@lo:400:kworker.0 00000100:00100000:0.0:1789708712.699246:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f53d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426292736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708712.699706:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708712.699775:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426293120 00000100:00100000:2.0:1789708712.699783:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426293120 00000100:00100000:2.0:1789708712.699838:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789708712.699848:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876645426293120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708712.699928:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876645426293120:12345-0@lo:400:kworker.0 Request processed in 82us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708712.699936:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1789708712.699958:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708712.699990:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876645426293120:0@lo:400:kworker.0 00000100:00100000:1.0:1789708712.704713:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708712.704782:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426293376:0@lo:400:kworker.0 00000100:00100000:1.0:1789708712.704823:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708712.704909:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426293376 00000100:00100000:1.0:1789708712.704917:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426293376 00000100:00100000:1.0:1789708712.704971:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789708712.704980:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426293376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708712.705033:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426293376:12345-0@lo:400:kworker.0 Request processed in 53us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708712.705040:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1789708712.705062:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708712.705087:0:3287:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1789708712.705092:0:3287:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a143f53ed80, transno 4294967310 00000004:00080000:1.0:1789708712.705103:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1789708712.705134:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f48f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426293376:0@lo:400:kworker.0 00000100:00100000:2.0:1789708712.706000:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426292864 00000100:00100000:2.0:1789708712.706007:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426292864 00000100:00100000:2.0:1789708712.706052:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789708712.706060:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3287:x1876645426292864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708712.706105:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3287:x1876645426292864:12345-0@lo:400:kworker.0 Request processed in 46us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708712.706111:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789708712.707534:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426292864:0@lo:400:kworker.0 00000100:00100000:3.0:1789708712.711077:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708712.712912:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426292992 00000100:00100000:1.0:1789708712.712926:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426292992 00000100:00100000:1.0:1789708712.712990:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789708712.713001:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426292992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708712.713077:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426292992:12345-0@lo:400:kworker.0 Request processed in 78us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708712.713196:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789708712.713455:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426292992:0@lo:400:kworker.0 00000100:00100000:0.0:1789708712.713581:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708712.713623:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876645426293248:0@lo:400:kworker.0 00000100:00100000:0.0:1789708712.713671:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708712.713702:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426293248 00000100:00100000:0.0:1789708712.713707:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426293248 00000100:00100000:0.0:1789708712.713757:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789708712.713765:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876645426293248:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789708712.713767:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708712.713809:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876645426293248:12345-0@lo:400:kworker.0 Request processed in 45us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708712.713817:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789708712.714240:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876645426293248:0@lo:400:kworker.0 00000100:00100000:3.0:1789708712.714718:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426292736 00000100:00100000:3.0:1789708712.714726:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426292736 00000100:00100000:3.0:1789708712.714792:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789708712.714805:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426292736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789708712.714850:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708712.714916:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426292736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708712.714923:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789708712.715020:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f53d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426292736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789708713.410339:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708714.426918:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789708715.397680:0:5841:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1789708715.397710:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1789708715.397719:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1789708715.452107:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708715.971914:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708715.972063:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415807872 00000100:00100000:2.0:1789708715.972075:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415807872 00000100:00100000:2.0:1789708715.972219:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 134 00000100:00100000:2.0:1789708715.972231:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+13:10220:x1876645415807872:12345-192.168.202.53@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789708715.972343:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+13:10220:x1876645415807872:12345-192.168.202.53@tcp:60:lhsmtool_posix.0 Request processed in 114us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708715.972352:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 134 00000100:00080000:1.0:1789708715.973130:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708715.984752:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708715.984883:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415808128 00000100:00100000:2.0:1789708715.984894:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415808128 00000100:00100000:2.0:1789708715.984954:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00100000:2.0:1789708715.984961:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+13:10220:x1876645415808128:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789708715.985351:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+14:10220:x1876645415808128:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 390us (607us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789708715.985367:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00100000:0.0:1789708716.283039:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708716.283137:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708716.283185:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708716.283265:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415808768 00000100:00100000:3.0:1789708716.283277:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415808768 00000100:00100000:3.0:1789708716.283363:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 103 00000100:00100000:3.0:1789708716.283374:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c9d2a103-cf70-4470-bdd0-387470668318+5:2362:x1876645415808768:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708716.283482:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c9d2a103-cf70-4470-bdd0-387470668318+5:2362:x1876645415808768:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 110us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708716.283490:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 103 00000100:00100000:1.0:1789708716.283575:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415808512 00000100:00100000:1.0:1789708716.283580:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415808512 00000100:00100000:1.0:1789708716.283625:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:1.0:1789708716.283634:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2362:x1876645415808512:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708716.283685:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2362:x1876645415808512:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 53us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708716.283691:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00080000:0.0:1789708716.283784:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789708716.283789:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708716.284241:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708716.284279:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708716.284359:0:11993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415808640 00000100:00100000:3.0:1789708716.284365:0:11993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415808640 00000100:00100000:3.0:1789708716.284409:0:11993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:3.0:1789708716.284417:0:11993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415808640:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708716.284458:0:11993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415808640:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 41us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708716.284465:0:11993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:1.0:1789708716.284581:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415808384 00000100:00100000:1.0:1789708716.284585:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415808384 00000100:00100000:1.0:1789708716.284626:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 104 00000100:00100000:1.0:1789708716.284635:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+14:2361:x1876645415808384:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708716.284695:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+14:2361:x1876645415808384:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 61us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708716.284702:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 104 00000100:00080000:0.0:1789708716.284924:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708716.285475:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415808256 00000100:00100000:2.0:1789708716.285481:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415808256 00000100:00100000:2.0:1789708716.285565:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 273 00000100:00100000:2.0:1789708716.285574:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2362:x1876645415808256:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708716.285624:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2362:x1876645415808256:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 52us (2597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708716.285631:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 273 00010000:00010000:1.0:1789708716.475362:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708717.306842:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a140366ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426293504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708717.306920:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708717.307077:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426293504 00000100:00100000:1.0:1789708717.307088:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426293504 00000100:00100000:1.0:1789708717.307172:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789708717.307183:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426293504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789708717.307220:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708717.307275:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426293504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708717.307305:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a140366ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426293504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708717.307532:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789708717.307603:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789708717.500060:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708717.819303:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f53ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426293632:0@lo:400:kworker.0 00000100:00100000:2.0:1789708717.819392:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708717.819746:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876645426294016:0@lo:400:kworker.0 00000100:00100000:0.0:1789708717.819793:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708717.820055:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426293632 00000100:00100000:1.0:1789708717.820065:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426293632 00000100:00100000:1.0:1789708717.820109:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789708717.820120:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426293632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708717.838890:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426293760:0@lo:400:kworker.0 00000100:00100000:3.0:1789708717.838976:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708717.839027:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789708717.839036:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426293888:0@lo:400:kworker.0 00000100:00100000:3.0:1789708717.839080:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708717.839167:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426294016 00000100:00100000:3.0:1789708717.839176:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426294016 00000100:00100000:3.0:1789708717.839229:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426293760 00000100:00100000:3.0:1789708717.839232:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426293760 00000100:00100000:3.0:1789708717.839247:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426293888 00000100:00100000:3.0:1789708717.839248:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426293888 00000100:00100000:3.0:1789708717.839264:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789708717.839680:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876645426294016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708717.839760:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876645426294016:12345-0@lo:400:kworker.0 Request processed in 488us (19966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708717.839768:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789708717.839788:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789708717.839795:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426293760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708717.839838:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426293760:12345-0@lo:400:kworker.0 Request processed in 43us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708717.839844:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789708717.839855:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789708717.839862:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426293888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708717.839894:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426293888:12345-0@lo:400:kworker.0 Request processed in 32us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708717.839899:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789708717.839958:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876645426294016:0@lo:400:kworker.0 00000100:00100000:3.0:1789708717.839977:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789708717.839983:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426294144:0@lo:400:kworker.0 00000100:00100000:3.0:1789708717.840012:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708717.840045:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426294272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789708717.840232:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708717.840258:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426293888:0@lo:400:kworker.0 00000100:00100000:3.0:1789708717.840268:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426293760:0@lo:400:kworker.0 00000100:00100000:1.0:1789708717.841935:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426293632:12345-0@lo:400:kworker.0 Request processed in 21809us (22535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708717.841949:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789708717.842002:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426294144 00000100:00100000:1.0:1789708717.842010:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426294144 00000100:00100000:1.0:1789708717.842080:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789708717.842089:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426294144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708717.842156:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426294144:12345-0@lo:400:kworker.0 Request processed in 69us (2143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708717.842164:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789708717.842183:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426294272 00000100:00100000:1.0:1789708717.842187:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426294272 00000100:00100000:1.0:1789708717.842213:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789708717.842220:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426294272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789708717.842248:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708717.843273:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426294272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1048us (3036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708717.843294:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789708717.843500:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426294272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708717.843678:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426294144:0@lo:400:kworker.0 00000100:00080000:0.0:1789708717.843834:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789708717.843842:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708717.847875:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f53ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426293632:0@lo:400:kworker.0 00000001:02000400:0.0:1789708718.164103:0:12286:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:18:36 (1789708716) 00010000:00010000:2.0:1789708718.524700:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708719.546882:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789708719.547492:0:11657:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789708719.547498:0:11657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708719.548085:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1789708719.548100:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789708720.024629:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708720.024859:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415809024 00000100:00100000:0.0:1789708720.024871:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415809024 00000100:00100000:0.0:1789708720.024960:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 135 00000100:00100000:0.0:1789708720.024973:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+14:11278:x1876645415809024:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708720.024994:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708720.025015:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866a2e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d49f2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789708720.025185:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789708720.027798:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866a35 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.027839:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866a35 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.027852:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866a35 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.027891:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866a3c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.027900:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866a3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.027906:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866a3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.032968:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c6866a43 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.032990:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c6866a43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.033001:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c6866a43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708720.033013:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789708720.033122:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866a35 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.033131:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866a35 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.033137:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866a35 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.033157:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708720.033161:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866a35 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.033169:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866a35 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.033182:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1414c38a00) 00010000:00010000:0.0:1789708720.033185:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708720.033190:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866a35 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.033214:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866a35 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.033230:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866a3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.033235:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866a3c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.033240:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866a3c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.033244:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708720.033246:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866a3c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.033252:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866a3c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.033270:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a14148f3f00) 00010000:00010000:0.0:1789708720.033273:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708720.033276:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866a3c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.033282:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866a3c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.038295:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866a2e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49f2 expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.038328:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c6866a43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49f2 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708720.038338:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1411b4a700) 00010000:00010000:0.0:1789708720.038341:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708720.038344:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23a00, rc 0) 00000100:00100000:0.0:1789708720.039012:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+16:11278:x1876645415809024:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 14036us (14388us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789708720.039023:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 135 00000100:00100000:1.0:1789708720.052765:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708720.053050:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415809152 00000100:00100000:3.0:1789708720.053062:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415809152 00000100:00100000:3.0:1789708720.053151:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 136 00000100:00100000:3.0:1789708720.053162:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+16:11278:x1876645415809152:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789708720.058277:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+16:11278:x1876645415809152:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 Request processed in 5103us (5507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708720.058295:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 136 00000100:00100000:1.0:1789708720.066956:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708720.067193:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415809280 00000100:00100000:3.0:1789708720.067204:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415809280 00000100:00100000:3.0:1789708720.069721:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:3.0:1789708720.069739:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1407f57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+16:2364:x1876645415809280:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708720.069756:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708720.069797:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c6866a43 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49f2 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708720.069819:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1411b4a700) 00010000:00010000:3.0:1789708720.069824:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708720.069894:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1407f57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+15:2364:x1876645415809280:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 160us (2948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708720.069901:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000001:00080000:3.0:1789708720.480710:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:1.0:1789708720.571412:0:11657:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789708720.571422:0:11657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708720.571885:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1789708720.571904:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789708720.572001:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708721.416985:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708721.419129:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708721.419177:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415809792 00000100:00100000:3.0:1789708721.419189:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415809792 00000100:00100000:1.0:1789708721.419206:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708721.419235:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708721.419256:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415809664 00000100:00100000:1.0:1789708721.419258:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708721.419259:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415809664 00000100:00100000:3.0:1789708721.419286:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:3.0:1789708721.419295:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2364:x1876645415809792:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708721.419377:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2364:x1876645415809792:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 83us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708721.419391:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:0.0:1789708721.419391:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415809536 00000100:00100000:0.0:1789708721.419395:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415809536 00000100:00100000:3.0:1789708721.419409:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:3.0:1789708721.419415:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2364:x1876645415809664:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708721.419421:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415809920 00000100:00100000:0.0:1789708721.419424:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415809920 00000100:00100000:3.0:1789708721.419444:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2364:x1876645415809664:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 29us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708721.419446:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 108 00000100:00100000:3.0:1789708721.419451:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:0.0:1789708721.419453:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+13:2364:x1876645415809536:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708721.419476:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 109 00000100:00100000:3.0:1789708721.419482:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c9d2a103-cf70-4470-bdd0-387470668318+5:2364:x1876645415809920:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708721.419482:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+13:2364:x1876645415809536:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 30us (2507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708721.419494:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 108 00000100:00100000:3.0:1789708721.419504:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c9d2a103-cf70-4470-bdd0-387470668318+5:2364:x1876645415809920:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 23us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708721.419511:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 109 00000100:00080000:0.0:1789708721.424892:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789708721.424908:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789708721.424911:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789708721.424934:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415809408 00000100:00100000:0.0:1789708721.424949:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415809408 00000100:00100000:0.0:1789708721.425916:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 275 00000100:00100000:0.0:1789708721.425934:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2364:x1876645415809408:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708721.426039:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2364:x1876645415809408:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 112us (6831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708721.426047:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 275 00010000:00010000:1.0:1789708721.594765:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708722.427132:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a140366c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426294400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708722.427204:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708722.429346:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426294400 00000100:00100000:2.0:1789708722.429360:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426294400 00000100:00100000:2.0:1789708722.429445:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789708722.429457:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426294400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789708722.429507:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789708722.429587:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426294400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (2382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708722.429595:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789708722.429672:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a140366c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426294400:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789708722.430306:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708722.615845:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708722.615920:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415810048 00000100:00100000:2.0:1789708722.615940:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415810048 00000100:00100000:2.0:1789708722.616022:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 137 00000100:00100000:2.0:1789708722.616034:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+13:11320:x1876645415810048:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708722.616057:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708722.616078:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866a51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d49f9 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616175:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a58 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616192:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616206:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616221:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616302:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616310:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616625:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789708722.616630:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789708722.616634:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a58 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616641:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616687:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708722.616691:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616698:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616711:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38000) 00010000:00010000:2.0:1789708722.616715:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708722.616720:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616725:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616737:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616743:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616748:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616753:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708722.616756:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616761:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616788:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a1414c38400) 00010000:00010000:2.0:1789708722.616790:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708722.616794:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a5f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616800:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616838:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866a51 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49f9 expref: 14 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616848:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38000) 00010000:00010000:2.0:1789708722.616850:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708722.616854:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866a51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49f9 expref: 14 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.616862:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6ba00, rc 0) 00000100:00100000:2.0:1789708722.616939:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+13:11320:x1876645415810048:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 907us (1103us total) trans 0 rc 301/301 00000100:00100000:2.0:1789708722.616949:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 137 00010000:00010000:0.0:1789708722.626911:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708722.632504:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708722.636286:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415810304 00000100:00100000:3.0:1789708722.636304:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415810304 00000100:00100000:3.0:1789708722.636374:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 138 00000100:00100000:3.0:1789708722.636387:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+13:11320:x1876645415810304:12345-192.168.202.53@tcp:36:lfs.0 00010000:00010000:3.0:1789708722.636448:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708722.636477:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c68663dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4839 expref: 13 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.636500:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38000) 00010000:00010000:3.0:1789708722.636512:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708722.642001:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c6866a66 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.642024:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c6866a66 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.642045:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c6866a66 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.642059:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c6866a6d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.642067:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c6866a6d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.642073:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c6866a6d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708722.643101:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789708722.643115:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c6866a66 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.643124:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c6866a66 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.643131:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c6866a66 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.643138:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14013a1c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708722.643143:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c6866a66 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.643151:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c6866a66 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.643165:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1411b4ad00) 00010000:00010000:3.0:1789708722.643169:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708722.643180:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c6866a66 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.643187:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c6866a66 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708722.643208:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d42e328 reply state 0000000013572c0c transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c6866a6d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708722.643216:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789708722.643329:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+14:11320:x1876645415810304:12345-192.168.202.53@tcp:36:lfs.0 Request processed in 6941us (10832us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789708722.643339:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 138 00010000:00010000:3.0:1789708722.649209:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c6866a6d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.649228:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c6866a6d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.649236:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c6866a6d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.649242:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14013a1e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708722.649247:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c6866a6d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.649255:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c6866a6d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.649271:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a1411b4a200) 00010000:00010000:3.0:1789708722.649274:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708722.649279:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c6866a6d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.649300:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c6866a6d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708722.772078:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708722.772563:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415810432 00000100:00100000:3.0:1789708722.772573:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415810432 00000100:00100000:3.0:1789708722.772624:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 139 00000100:00100000:3.0:1789708722.772631:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+13:11328:x1876645415810432:12345-192.168.202.53@tcp:101:lctl.0 00010000:00010000:3.0:1789708722.772678:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708722.772705:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c6866a74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a00 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.772773:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c6866a7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.772787:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c6866a7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.772802:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c6866a7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708722.772841:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789708722.772845:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789708722.772866:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c6866a7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.772890:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c6866a74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a00 expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.772906:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c6866a7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a00 expref: 14 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.772923:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:3.0:1789708722.772926:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789708722.772929:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14013a1c00, rc 0) 00000100:00100000:3.0:1789708722.772990:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+14:11328:x1876645415810432:12345-192.168.202.53@tcp:101:lctl.0 Request processed in 359us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708722.773527:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 139 00000100:00100000:1.0:1789708722.904123:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708722.904232:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415810560 00000100:00100000:2.0:1789708722.904242:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415810560 00000100:00100000:2.0:1789708722.904320:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 140 00000100:00100000:2.0:1789708722.904333:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+14:11334:x1876645415810560:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1789708722.904358:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708722.904380:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a07 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904481:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904496:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904507:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904522:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866a90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904529:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866a90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904536:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866a90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904722:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866a97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904731:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904739:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708722.904780:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789708722.904784:0:11601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789708722.904803:0:11601:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904827:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904833:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904839:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904845:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708722.904848:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904855:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904866:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:2.0:1789708722.904869:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708722.904874:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904879:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866a89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904892:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866a90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904897:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866a90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904902:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866a90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904913:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6ac00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708722.904917:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866a90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904923:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866a90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904931:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a1414c38400) 00010000:00010000:2.0:1789708722.904933:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708722.904936:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866a90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904941:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866a90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904974:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866a82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a07 expref: 16 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904987:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a07 expref: 15 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.904995:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:2.0:1789708722.904997:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789708722.904999:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6ba00, rc 0) 00000100:00100000:2.0:1789708722.905059:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+15:11334:x1876645415810560:12345-192.168.202.53@tcp:101:bash.0 Request processed in 729us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708722.905068:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 140 00000100:00100000:2.0:1789708722.909564:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708722.909711:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415810816 00000100:00100000:3.0:1789708722.909722:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415810816 00000100:00100000:3.0:1789708722.909790:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 141 00000100:00100000:3.0:1789708722.909801:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+15:11334:x1876645415810816:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:3.0:1789708722.909825:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708722.909846:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c6866a9e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a0e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.910211:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866aa5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.910225:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866aa5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.910237:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866aa5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.910285:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866aac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.910294:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866aac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.910309:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866aac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789708722.910914:0:5820:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1789708722.911071:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866ab3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.911081:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.911089:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.911120:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866aa5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.911127:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866aa5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.911133:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866aa5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.911139:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708722.911143:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866aa5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.911149:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866aa5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.911161:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:0.0:1789708722.911164:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708722.911177:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866aa5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.911183:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866aa5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708722.911198:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fbd046c reply state 0000000002faaade transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866aac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708722.911207:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789708722.911236:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c6866a9e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a0e expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.911251:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a0e expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.911258:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:0.0:1789708722.911260:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708722.911263:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23c00, rc 0) 00000100:00100000:0.0:1789708722.911646:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+18:11334:x1876645415810816:12345-192.168.202.53@tcp:101:bash.0 Request processed in 1845us (2090us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789708722.911674:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 141 00000100:00100000:1.0:1789708722.920551:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708722.920693:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415810944 00000100:00100000:0.0:1789708722.920704:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415810944 00000100:00100000:0.0:1789708722.920774:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:0.0:1789708722.920785:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2363:x1876645415810944:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1789708722.920806:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708722.920829:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4cb08b0/0xa8f741d1c6866ac1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a15 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.920874:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866aac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708722.920877:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789708722.920893:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866aac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.920900:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=288s v=(0 0) 00010000:00010000:3.0:1789708722.920901:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866aac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.920905:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708722.920907:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708722.920912:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866aac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.920914:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4cb08b0/0xa8f741d1c6866ac1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a15 expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.920929:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866aac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708722.920933:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d4cb08b0/0xa8f741d1c6866ac1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a15 expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.920945:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a14148f3500) 00010000:00010000:0.0:1789708722.920946:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23000, rc 0) 00010000:00010000:3.0:1789708722.920947:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708722.920951:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866aac lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.920957:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866aac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708722.921017:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2363:x1876645415810944:12345-192.168.202.53@tcp:101:bash.0 Request processed in 233us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708722.921025:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:1.0:1789708722.931735:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708722.931831:0:11993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415811072 00000100:00100000:3.0:1789708722.931843:0:11993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415811072 00000100:00100000:3.0:1789708722.931918:0:11993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 48 00000100:00100000:3.0:1789708722.931930:0:11993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+6:11334:x1876645415811072:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:3.0:1789708722.931955:0:11993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708722.931978:0:11993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c576da8f/0xa8f741d1c6866ac8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a1c expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.932027:0:11993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4cb08b0/0xa8f741d1c6866ac1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a15 expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.932038:0:11993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708722.932043:0:11993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708722.932050:0:11993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c576da8f/0xa8f741d1c6866ac8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a1c expref: 7 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.932096:0:11993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4cb08b0/0xa8f741d1c6866ac1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a15 expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.932132:0:11993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4cb08b0/0xa8f741d1c6866ac1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a15 expref: 7 pid: 6672 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708722.932151:0:11993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11993:1876645426294528:192.168.202.53@tcp:104: 00000100:00100000:3.0:1789708722.932393:0:11993:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140766aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708722.935916:0:11993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11993:1876645426294528:192.168.202.53@tcp:104: 00010000:00010000:3.0:1789708722.935963:0:11993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c576da8f/0xa8f741d1c6866ac8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a1c expref: 7 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708722.935989:0:11993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14013a0200, rc 0) 00000100:00100000:3.0:1789708722.936074:0:11993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+7:11334:x1876645415811072:12345-192.168.202.53@tcp:101:bash.0 Request processed in 4146us (4349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708722.936084:0:11993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 48 00000100:00100000:0.0:1789708722.936211:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708722.936427:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415811200 00000100:00100000:2.0:1789708722.936435:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415811200 00010000:00010000:2.0:1789708722.936473:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4cb08b0/0xa8f741d1c6866ac1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a15 expref: 7 pid: 6672 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708722.936513:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:2.0:1789708722.936523:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2361:x1876645415811200:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708722.936548:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708722.936572:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4cb08b0/0xa8f741d1c6866ac1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a15 expref: 7 pid: 6672 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.936586:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4cb08b0/0xa8f741d1c6866ac1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a15 expref: 7 pid: 6672 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.936611:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4cb08b0/0xa8f741d1c6866ac1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a15 expref: 7 pid: 6672 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.936627:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708722.936632:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708722.936641:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c576da8f/0xa8f741d1c6866ac8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a1c expref: 6 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.936696:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c576da8f/0xa8f741d1c6866ac8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a1c expref: 6 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708722.936731:0:5804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c576da8f/0xa8f741d1c6866ac8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a1c expref: 6 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708722.936768:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a140366fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5804:1876645426294656:192.168.202.53@tcp:105: 00000100:00100000:2.0:1789708722.936830:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1307f32300 going to sleep for 11 seconds 00000100:00100000:3.0:1789708722.939115:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426295040:0@lo:400:kworker.0 00000100:00100000:3.0:1789708722.939177:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708722.939238:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426295040 00000100:00100000:3.0:1789708722.939245:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426295040 00000100:00100000:3.0:1789708722.939293:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789708722.939302:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426295040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708722.939328:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876645426294912:0@lo:400:kworker.0 00000100:00100000:3.0:1789708722.939351:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426295040:12345-0@lo:400:kworker.0 Request processed in 50us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708722.939354:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708722.939358:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789708722.939374:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426294912 00000100:00100000:2.0:1789708722.939375:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789708722.939381:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426294784:0@lo:400:kworker.0 00000100:00100000:3.0:1789708722.939389:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426294912 00000100:00100000:2.0:1789708722.939407:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708722.939409:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789708722.939415:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876645426294912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708722.939449:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876645426294912:12345-0@lo:400:kworker.0 Request processed in 34us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708722.939465:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876645426294912:0@lo:400:kworker.0 00000100:00100000:3.0:1789708722.939469:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789708722.939493:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426295040:0@lo:400:kworker.0 00000100:00100000:3.0:1789708722.939539:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789708722.939546:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876645426295168:0@lo:400:kworker.0 00000100:00100000:3.0:1789708722.939568:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708722.940832:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789708722.940849:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426295296:0@lo:400:kworker.0 00000100:00100000:2.0:1789708722.940894:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789708722.941997:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708722.942025:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426294784 00000100:00100000:1.0:1789708722.942036:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426294784 00000100:00100000:1.0:1789708722.942106:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789708722.942115:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426294784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708722.942217:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426294784:12345-0@lo:400:kworker.0 Request processed in 102us (2807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708722.942557:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789708722.942603:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426295168 00000100:00100000:1.0:1789708722.942608:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426295168 00000100:00100000:3.0:1789708722.942730:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426295296 00000100:00100000:3.0:1789708722.942734:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426295296 00000100:00100000:1.0:1789708722.942748:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789708722.942754:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876645426295168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708722.942812:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876645426295168:12345-0@lo:400:kworker.0 Request processed in 57us (3242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708722.942819:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789708722.942873:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876645426295168:0@lo:400:kworker.0 00000100:00100000:1.0:1789708722.942909:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426294784:0@lo:400:kworker.0 00000100:00080000:2.0:1789708722.948141:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789708722.948152:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708722.948394:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a140366fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5804:1876645426294656:192.168.202.53@tcp:105: 00010000:00010000:2.0:1789708722.948419:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708722.948427:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789708722.948439:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426295296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708722.948507:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426295296:12345-0@lo:400:kworker.0 Request processed in 72us (7613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708722.948515:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789708722.949073:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e95b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426295424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708722.949118:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708722.949156:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426295296:0@lo:400:kworker.0 00000100:00100000:2.0:1789708722.954435:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415811200:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 17899us (18209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708722.954455:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:2.0:1789708722.954969:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426295424 00000100:00100000:2.0:1789708722.954981:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426295424 00000100:00100000:2.0:1789708722.955036:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789708722.955046:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426295424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789708722.955096:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789708722.955193:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426295424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (6074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708722.955217:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789708722.955409:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e95b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426295424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708722.956432:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708722.959862:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415811456 00000100:00100000:2.0:1789708722.959878:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415811456 00000100:00100000:2.0:1789708722.959980:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:2.0:1789708722.959993:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+17:11334:x1876645415811456:12345-192.168.202.53@tcp:35:bash.0 00000100:00100000:2.0:1789708722.960362:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+18:11334:x1876645415811456:12345-192.168.202.53@tcp:35:bash.0 Request processed in 371us (3934us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789708722.960371:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:0.0:1789708723.078182:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708723.078337:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415811712 00000100:00100000:2.0:1789708723.078347:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415811712 00000100:00100000:2.0:1789708723.078407:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 142 00000100:00100000:2.0:1789708723.078417:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+18:11344:x1876645415811712:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708723.078441:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708723.078475:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866acf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a23 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708723.078567:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789708723.078722:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866acf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a23 expref: 20 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.078737:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:2.0:1789708723.078740:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789708723.078745:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866acf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a23 expref: 20 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.078772:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6b600, rc 0) 00000100:00100000:2.0:1789708723.078837:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+19:11344:x1876645415811712:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 421us (666us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1789708723.078845:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 142 00000100:00100000:0.0:1789708723.094734:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708723.094892:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415811968 00000100:00100000:2.0:1789708723.094904:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415811968 00000100:00100000:2.0:1789708723.094975:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:2.0:1789708723.094985:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+19:11344:x1876645415811968:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1789708723.095250:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+20:11344:x1876645415811968:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 265us (525us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1789708723.095260:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:0.0:1789708723.198539:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708723.198701:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415812096 00000100:00100000:1.0:1789708723.198714:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415812096 00000100:00100000:1.0:1789708723.198975:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 143 00000100:00100000:1.0:1789708723.198986:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+20:11350:x1876645415812096:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1789708723.199181:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708723.199204:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866add lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a2a expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.199363:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866ae4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.199377:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.199388:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708723.199422:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789708723.199425:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789708723.199444:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.199547:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866add lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a2a expref: 22 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.199565:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a2a expref: 21 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.199574:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:1.0:1789708723.199576:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708723.199580:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5400, rc 0) 00000100:00100000:1.0:1789708723.199829:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+21:11350:x1876645415812096:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 843us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708723.199838:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 143 00000100:00100000:0.0:1789708723.217349:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708723.217451:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415812352 00000100:00100000:1.0:1789708723.217474:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415812352 00000100:00100000:1.0:1789708723.217563:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 144 00000100:00100000:1.0:1789708723.217577:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+21:11350:x1876645415812352:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1789708723.217604:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708723.217630:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866aeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a31 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.217823:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c6866af2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.217841:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c6866af2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.217854:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c6866af2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708723.217866:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789708723.218034:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866aeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a31 expref: 24 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.218055:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c6866af2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a31 expref: 23 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.218065:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:1.0:1789708723.218068:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708723.218071:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4800, rc 0) 00000100:00100000:1.0:1789708723.218126:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+23:11350:x1876645415812352:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 552us (787us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1789708723.218134:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 144 00000100:00100000:0.0:1789708723.222831:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708723.222929:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415812480 00000100:00100000:3.0:1789708723.222942:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415812480 00000100:00100000:3.0:1789708723.223021:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:3.0:1789708723.223033:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+23:2361:x1876645415812480:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708723.223054:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708723.223083:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c6866af2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a31 expref: 23 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.223101:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:3.0:1789708723.223122:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708723.223190:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+22:2361:x1876645415812480:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 159us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708723.223198:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:0.0:1789708723.223965:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708723.224083:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415812736 00000100:00100000:3.0:1789708723.224090:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415812736 00000100:00100000:3.0:1789708723.224134:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 145 00000100:00100000:3.0:1789708723.224143:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+22:11350:x1876645415812736:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1789708723.224162:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708723.224181:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c6866b00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a38 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.224280:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866b07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.224297:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866b07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.224309:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866b07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708723.224323:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789708723.224480:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1e00/0xa8f741d1c6866b00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a38 expref: 25 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.224499:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866b07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a38 expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.224507:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:3.0:1789708723.224521:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789708723.224525:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39e00, rc 0) 00000100:00100000:3.0:1789708723.224587:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+24:11350:x1876645415812736:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 444us (625us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789708723.224593:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 145 00000100:00100000:2.0:1789708723.235256:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708723.235363:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415812864 00000100:00100000:1.0:1789708723.235395:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415812864 00000100:00100000:1.0:1789708723.235485:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:1.0:1789708723.235496:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2363:x1876645415812864:12345-192.168.202.53@tcp:1:lfs.0 00010000:00010000:1.0:1789708723.235558:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e3a0ec/0xa8f741d1c6866b15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.235581:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c576da8f/0xa8f741d1c6866ac8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a1c expref: 6 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.235591:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789708723.235597:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708723.235602:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e3a0ec/0xa8f741d1c6866b15 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.235639:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c576da8f/0xa8f741d1c6866ac8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a1c expref: 6 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.235687:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c576da8f/0xa8f741d1c6866ac8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a1c expref: 6 pid: 11993 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708723.235703:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e95b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6673:1876645426295552:192.168.202.53@tcp:104: 00000100:00100000:1.0:1789708723.235811:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1407e23cc0 going to sleep for 11 seconds 00000100:00080000:2.0:1789708723.235966:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708723.239848:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e95b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6673:1876645426295552:192.168.202.53@tcp:104: 00010000:00010000:1.0:1789708723.239886:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003e3a0ec/0xa8f741d1c6866b15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708723.240078:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708723.240135:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415812992 00000100:00100000:3.0:1789708723.240145:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415812992 00002000:00100000:3.0:1789708723.240194:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8a140366d880 x1876645415812992/t0(0) o4->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:109/0 lens 504/0 e 0 to 0 dl 1789708734 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789708723.240205:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a140366d880 with x1876645415812992 ext(0->12) 00010000:00010000:3.0:1789708723.240212:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c576da8f/0xa8f741d1c6866ac8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a1c expref: 7 pid: 11993 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.240232:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c576da8f/0xa8f741d1c6866ac8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a1c expref: 7 pid: 11993 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789708723.240241:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a140366d880 00000100:00100000:3.0:1789708723.240274:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:3.0:1789708723.240285:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2362:x1876645415812992:12345-192.168.202.53@tcp:4:lfs.0 00000100:00100000:3.0:1789708723.240945:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+9:2362:x1876645415812992:12345-192.168.202.53@tcp:4:lfs.0 Request processed in 659us (866us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789708723.240955:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 2 00002000:00100000:3.0:1789708723.240963:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8a140366d880 x1876645415812992/t4294967305(0) o4->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:109/0 lens 504/448 e 0 to 0 dl 1789708734 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789708723.240973:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a140366d880 with x1876645415812992 ext(0->12) 00010000:00010000:3.0:1789708723.240986:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c576da8f/0xa8f741d1c6866ac8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a1c expref: 9 pid: 11993 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.241006:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c576da8f/0xa8f741d1c6866ac8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a1c expref: 9 pid: 11993 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789708723.241013:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a140366d880 00000100:00100000:0.0:1789708723.250850:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708723.250968:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415813120 00000100:00100000:1.0:1789708723.250982:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415813120 00010000:00010000:1.0:1789708723.251041:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c576da8f/0xa8f741d1c6866ac8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a1c expref: 9 pid: 11993 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708723.251253:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:1.0:1789708723.251265:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+9:2361:x1876645415813120:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708723.251283:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789708723.251305:0:5806:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789708723.251308:0:5806:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789708723 00002000:00010000:1.0:1789708723.251311:0:5806:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789708723 00002000:00010000:1.0:1789708723.251324:0:5806:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789708723 00010000:00010000:1.0:1789708723.251331:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c576da8f/0xa8f741d1c6866ac8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a1c expref: 9 pid: 11993 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.251349:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c576da8f/0xa8f741d1c6866ac8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a1c expref: 9 pid: 11993 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.251378:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c576da8f/0xa8f741d1c6866ac8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a1c expref: 9 pid: 11993 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.251397:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708723.251402:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708723.251409:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e3a0ec/0xa8f741d1c6866b15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.251441:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e3a0ec/0xa8f741d1c6866b15 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.251536:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708723.251604:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2361:x1876645415813120:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 340us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708723.251614:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 60 00010000:00010000:3.0:1789708723.252455:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003e3a0ec/0xa8f741d1c6866b15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.252470:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e3a0ec/0xa8f741d1c6866b15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.252501:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003e3a0ec/0xa8f741d1c6866b15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.252510:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003e3a0ec/0xa8f741d1c6866b15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.252518:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003e3a0ec/0xa8f741d1c6866b15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.252526:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5200 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708723.252530:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e3a0ec/0xa8f741d1c6866b15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.252538:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003e3a0ec/0xa8f741d1c6866b15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.252565:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003e3a0ec/0xa8f741d1c6866b15 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.252572:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e3a0ec/0xa8f741d1c6866b15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708723.252639:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2363:x1876645415812864:12345-192.168.202.53@tcp:1:lfs.0 Request processed in 17143us (17396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708723.252676:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:0.0:1789708723.255730:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708723.255839:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415813376 00000100:00100000:2.0:1789708723.255852:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415813376 00000100:00100000:2.0:1789708723.256004:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 38 00000100:00100000:2.0:1789708723.256020:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14069f9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+24:11350:x1876645415813376:12345-192.168.202.53@tcp:35:lfs.0 00000004:00010000:2.0:1789708723.256103:0:5823:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866b07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a38 expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789708723.256404:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1789708723.256449:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1789708723.257149:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1789708723.257212:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b1c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.257233:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866ab3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a0e expref: 28 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.257254:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b1c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.257292:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a0e expref: 28 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.257307:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a0e expref: 28 pid: 5820 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708723.257321:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a140366f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5823:1876645426295680:192.168.202.53@tcp:104: 00000100:00100000:2.0:1789708723.257414:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1307f32d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708723.261479:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708723.262076:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415813504 00000100:00100000:3.0:1789708723.262102:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415813504 00010000:00010000:3.0:1789708723.262144:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866ab3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a0e expref: 29 pid: 5820 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708723.262183:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:3.0:1789708723.262193:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+29:2362:x1876645415813504:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708723.262207:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708723.262214:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866ab3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a0e expref: 29 pid: 5820 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.262582:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a0e expref: 29 pid: 5820 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.262609:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:3.0:1789708723.262614:0:8435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b1c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.262637:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.262644:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b1c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.262686:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708723.262753:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+29:2362:x1876645415813504:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 561us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708723.262773:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 61 00010000:00010000:2.0:1789708723.263931:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866ab3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a0e expref: 28 pid: 5820 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708723.263955:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a140366f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5823:1876645426295680:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708723.263978:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.263987:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.264055:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789708723.264387:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1789708723.264816:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1789708723.264936:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a140366f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5823:1876645426295808:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789708723.265067:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708723.265201:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1307f32cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708723.265346:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426295808 00000100:00100000:0.0:1789708723.265359:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426295808 00000100:00100000:0.0:1789708723.265454:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789708723.265463:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5823:x1876645426295808:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789708723.265547:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5823:x1876645426295808:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 85us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708723.265555:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789708723.265611:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a140366f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5823:1876645426295808:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789708723.266188:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1789708723.266266:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a140366f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5823:1876645426295936:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789708723.266310:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708723.267020:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1307f32d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708723.267145:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426295936 00000100:00100000:1.0:1789708723.267153:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426295936 00000100:00100000:1.0:1789708723.267193:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789708723.267201:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5823:x1876645426295936:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789708723.267614:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5823:x1876645426295936:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 412us (1301us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789708723.267623:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789708723.267771:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a140366f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5823:1876645426295936:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789708723.267840:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1789708723.267882:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.267894:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b1c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.267902:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b1c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.267908:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708723.267913:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b1c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.267921:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b1c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.267937:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:2.0:1789708723.267940:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789708723.267944:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b1c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.267965:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b1c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789708723.268423:0:5823:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789708723.268521:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1789708723.268531:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 289065880502ns, next at 290065877783ns, rc = 0 00000001:00080000:2.0:1789708723.268537:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1789708723.268567:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:2.0:1789708723.268570:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789708723.268577:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866b07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a38 expref: 32 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708723.268726:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14069f9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+31:11350:x1876645415813376:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 12708us (13005us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1789708723.268736:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 38 00000020:00080000:2.0:1789708723.268740:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789708723.273288:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708723.273792:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415813632 00000100:00100000:1.0:1789708723.273805:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415813632 00000100:00100000:1.0:1789708723.273909:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 146 00000100:00100000:1.0:1789708723.273919:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+31:11350:x1876645415813632:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1789708723.273945:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708723.273971:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866b23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a3f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.274053:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866b23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a3f expref: 32 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.274091:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866b23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a3f expref: 32 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.274112:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:1.0:1789708723.274115:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708723.274120:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5a00, rc 0) 00000100:00100000:1.0:1789708723.274190:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+32:11350:x1876645415813632:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 272us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708723.274197:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 146 00000100:00100000:3.0:1789708723.277631:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708723.281199:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415813888 00000100:00100000:0.0:1789708723.281215:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415813888 00000100:00100000:0.0:1789708723.281304:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:0.0:1789708723.281315:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+32:11350:x1876645415813888:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:0.0:1789708723.281589:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+33:11350:x1876645415813888:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 274us (3968us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1789708723.281597:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:2.0:1789708723.410263:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708723.410381:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415814144 00000100:00100000:0.0:1789708723.410395:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415814144 00000100:00100000:0.0:1789708723.410468:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 147 00000100:00100000:0.0:1789708723.410480:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+33:11360:x1876645415814144:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1789708723.410512:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708723.410535:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866b2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a46 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708723.410694:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789708723.410843:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866b2a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a46 expref: 35 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708723.410858:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:0.0:1789708723.410874:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789708723.410881:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866b2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a46 expref: 35 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708723.410896:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23800, rc 0) 00000100:00100000:0.0:1789708723.410971:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+34:11360:x1876645415814144:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 494us (721us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1789708723.410980:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 147 00000100:00100000:3.0:1789708723.426362:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708723.427135:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415814272 00000100:00100000:2.0:1789708723.427148:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415814272 00000100:00100000:2.0:1789708723.427232:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 148 00000100:00100000:2.0:1789708723.427243:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+34:11360:x1876645415814272:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:2.0:1789708723.427332:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b38 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427351:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427363:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427397:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427404:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427409:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427504:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866b46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427513:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427519:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789708723.427575:0:7140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427588:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427595:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b38 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427602:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427609:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708723.427613:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427627:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b38 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427641:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:2.0:1789708723.427644:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708723.427681:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427688:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866b38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427703:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427709:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427715:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427720:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6be00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708723.427723:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427729:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427736:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1414c38400) 00010000:00010000:2.0:1789708723.427738:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708723.427741:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427771:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427785:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427790:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866b46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427796:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866b46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427800:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6bc00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708723.427803:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866b46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427808:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866b46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427816:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:2.0:1789708723.427818:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708723.427821:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866b46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708723.427825:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866b46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708723.427911:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+34:11360:x1876645415814272:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 666us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708723.427920:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 148 00000100:00100000:1.0:1789708723.431608:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708723.431725:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415814528 00000100:00100000:0.0:1789708723.431736:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415814528 00000100:00100000:0.0:1789708723.431822:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:0.0:1789708723.431834:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+34:11360:x1876645415814528:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:0.0:1789708723.432121:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+35:11360:x1876645415814528:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 288us (523us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789708723.432128:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:2.0:1789708723.512173:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708723.512309:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415814784 00000100:00100000:1.0:1789708723.512322:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415814784 00000100:00100000:1.0:1789708723.512390:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 149 00000100:00100000:1.0:1789708723.512401:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+35:11364:x1876645415814784:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1789708723.512430:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708723.512453:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866b4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a4d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.512532:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c6866b54 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.512548:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c6866b54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.512561:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c6866b54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.512597:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866b5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.512605:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.512611:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.512773:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866b62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.512782:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866b62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.512789:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866b62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708723.512800:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789708723.512917:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c6866b54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.512926:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c6866b54 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.512932:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c6866b54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.512937:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708723.512942:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c6866b54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.512962:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c6866b54 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.512976:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:1.0:1789708723.512979:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708723.512984:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c6866b54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.513070:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4800/0xa8f741d1c6866b54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.513098:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.513104:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866b5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.513111:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866b5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.513116:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708723.513119:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866b5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.513124:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866b5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.513131:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a14033c4d00) 00010000:00010000:1.0:1789708723.513134:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708723.513136:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866b5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.513151:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866b5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.513197:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866b4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a4d expref: 38 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.513211:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866b62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a4d expref: 37 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.513488:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:1.0:1789708723.513491:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708723.513494:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4600, rc 0) 00000100:00100000:1.0:1789708723.513579:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+37:11364:x1876645415814784:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1178us (1415us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1789708723.513588:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 149 00000100:00100000:1.0:1789708723.523406:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708723.523767:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415814912 00000100:00100000:3.0:1789708723.523779:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415814912 00000100:00100000:3.0:1789708723.523836:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 150 00000100:00100000:3.0:1789708723.523846:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+37:11364:x1876645415814912:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:3.0:1789708723.523909:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866b70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.523927:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866b70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.523938:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866b70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.523964:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866b70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.523970:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866b70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.523985:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866b70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.523991:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708723.523995:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866b70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.524002:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866b70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.524014:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:3.0:1789708723.524016:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789708723.524021:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866b70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708723.524028:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866b70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708723.524129:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+37:11364:x1876645415814912:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 284us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708723.524137:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 150 00000100:00100000:3.0:1789708723.533366:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708723.533460:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415815168 00000100:00100000:0.0:1789708723.533474:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415815168 00000100:00100000:0.0:1789708723.533542:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00100000:0.0:1789708723.533553:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+37:11364:x1876645415815168:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:0.0:1789708723.533997:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+38:11364:x1876645415815168:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 433us (630us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789708723.534007:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 41 00000001:00080000:3.0:1789708723.540626:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:3.0:1789708723.540691:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:1.0:1789708723.642936:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708723.893149:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708723.893267:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415815424 00000100:00100000:1.0:1789708723.893279:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415815424 00000100:00100000:1.0:1789708723.893346:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 151 00000100:00100000:1.0:1789708723.893356:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+38:11395:x1876645415815424:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:1.0:1789708723.893379:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708723.893399:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866b77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a54 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.893499:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866b7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.893526:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866b7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.893537:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866b7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708723.893550:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789708723.893718:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866b77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a54 expref: 41 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.893739:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866b7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a54 expref: 40 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.893749:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:1.0:1789708723.893764:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708723.893767:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4400, rc 0) 00000100:00100000:1.0:1789708723.893940:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+40:11395:x1876645415815424:12345-192.168.202.53@tcp:101:cat.0 Request processed in 584us (800us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789708723.893948:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 151 00000100:00100000:3.0:1789708723.924521:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708723.924572:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708723.924689:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415815808 00000100:00100000:1.0:1789708723.924699:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415815808 00000100:00100000:1.0:1789708723.924798:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:1.0:1789708723.924812:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+40:2361:x1876645415815808:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708723.924833:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708723.924859:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866b7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a54 expref: 40 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708723.924895:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:1.0:1789708723.924900:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708723.924960:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+39:2361:x1876645415815808:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 151us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708723.924967:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:0.0:1789708723.927894:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415815680 00000100:00100000:0.0:1789708723.927910:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415815680 00000100:00100000:0.0:1789708723.927982:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:0.0:1789708723.927992:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+39:11395:x1876645415815680:12345-192.168.202.53@tcp:35:cat.0 00000100:00100000:0.0:1789708723.928298:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+40:11395:x1876645415815680:12345-192.168.202.53@tcp:35:cat.0 Request processed in 306us (3786us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789708723.928306:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:3.0:1789708724.002169:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708724.002287:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415816064 00000100:00100000:2.0:1789708724.002297:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415816064 00000100:00100000:2.0:1789708724.002373:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 152 00000100:00100000:2.0:1789708724.002383:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+40:11401:x1876645415816064:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:2.0:1789708724.002407:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708724.002410:0:11601:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789708724.002437:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866ae4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a2a expref: 40 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.002455:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:2.0:1789708724.002460:0:11601:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708724.002473:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866b8c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a5b expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.002589:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.002604:0:11601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866b62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a4d expref: 40 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.002612:0:11601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b93 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.002643:0:11601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866b62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a4d expref: 40 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.002704:0:11601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866b62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a4d expref: 40 pid: 5819 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708724.002736:0:11601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a140366ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11601:1876645426296064:192.168.202.53@tcp:104: 00000100:00100000:2.0:1789708724.002851:0:11601:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1307f32600 going to sleep for 11 seconds 00000100:00080000:1.0:1789708724.003034:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708724.006948:0:11601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a140366ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11601:1876645426296064:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708724.006977:0:11601:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708724.009538:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708724.009840:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415816192 00000100:00100000:0.0:1789708724.009850:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415816192 00010000:00010000:0.0:1789708724.009892:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866b62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a4d expref: 41 pid: 5819 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708724.009937:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 62 00000100:00100000:0.0:1789708724.009946:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+41:2361:x1876645415816192:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708724.009960:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708724.009967:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866b62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a4d expref: 41 pid: 5819 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.009981:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866b62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a4d expref: 41 pid: 5819 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.010002:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866b62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a4d expref: 41 pid: 5819 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.010019:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:0.0:1789708724.010024:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.010034:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.010042:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b93 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.010090:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708724.010159:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+40:2361:x1876645415816192:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 213us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708724.010166:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 62 00010000:00010000:2.0:1789708724.010280:0:11601:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.010289:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708724.010309:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789708724.010457:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866b8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a5b expref: 41 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.010473:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a5b expref: 40 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.010480:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:2.0:1789708724.010483:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789708724.010486:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6be00, rc 0) 00000100:00100000:2.0:1789708724.010527:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+40:11401:x1876645415816064:12345-192.168.202.53@tcp:101:dd.0 Request processed in 8146us (8369us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789708724.010535:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 152 00000100:00100000:3.0:1789708724.014831:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708724.016001:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415816448 00000100:00100000:1.0:1789708724.016017:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415816448 00000100:00100000:1.0:1789708724.016089:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 153 00000100:00100000:1.0:1789708724.016100:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+40:11401:x1876645415816448:12345-192.168.202.53@tcp:36:dd.0 00010000:00010000:1.0:1789708724.016369:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ba1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.016386:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.016397:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789708724.016461:0:7140:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1789708724.016498:0:7140:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd4a4047 reply state 00000000ebb845ff transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708724.016507:0:7140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789708724.016608:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+43:11401:x1876645415816448:12345-192.168.202.53@tcp:36:dd.0 Request processed in 509us (1786us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1789708724.016616:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 153 00000020:00080000:1.0:1789708724.016621:0:7140:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789708724.020962:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ba1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.020981:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ba1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.020990:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ba1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.020997:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708724.021001:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ba1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.021008:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ba1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.021024:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:1.0:1789708724.021027:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708724.021032:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ba1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.021037:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ba1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708724.427621:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708724.427765:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415816576 00000100:00100000:0.0:1789708724.427775:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415816576 00000100:00100000:0.0:1789708724.427836:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 154 00000100:00100000:0.0:1789708724.427844:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+42:11415:x1876645415816576:12345-192.168.202.53@tcp:101:stat.0 00010000:00010000:0.0:1789708724.427870:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708724.427892:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c6866ba8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a62 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.427961:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866baf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.427976:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866baf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.427999:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866baf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.428014:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866bb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.428020:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.428027:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.428130:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866bbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.428142:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b93 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a5b expref: 43 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.428151:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866bbd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.428186:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a5b expref: 43 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.428200:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a5b expref: 43 pid: 11601 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708724.428214:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308bd8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1876645426296192:192.168.202.53@tcp:104: 00000100:00100000:0.0:1789708724.428342:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308463480 going to sleep for 11 seconds 00000100:00100000:1.0:1789708724.435160:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708724.435259:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415816832 00000100:00100000:2.0:1789708724.435283:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415816832 00000100:00100000:2.0:1789708724.435348:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:2.0:1789708724.435360:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+44:5592:x1876645415816832:12345-192.168.202.53@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789708724.435766:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+45:5592:x1876645415816832:12345-192.168.202.53@tcp:35:ldlm_bl.0 Request processed in 406us (614us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1789708724.435774:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:0.0:1789708724.435956:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308bd8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1876645426296192:192.168.202.53@tcp:104: 00010000:00010000:0.0:1789708724.435983:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866bbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708724.446001:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708724.446121:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415816960 00000100:00100000:2.0:1789708724.446132:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415816960 00010000:00010000:2.0:1789708724.446181:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a5b expref: 45 pid: 11601 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708724.446230:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:2.0:1789708724.446240:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1407f56850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+45:2361:x1876645415816960:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708724.446259:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708724.446267:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a5b expref: 45 pid: 11601 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.446281:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a5b expref: 45 pid: 11601 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.446307:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866b93 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a5b expref: 45 pid: 11601 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.446324:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:2.0:1789708724.446330:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866bbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.446357:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866bbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.446364:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866bbd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.446395:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708724.446461:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1407f56850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+44:2361:x1876645415816960:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 221us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708724.446469:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 63 00010000:00010000:1.0:1789708724.446574:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866bbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446582:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866bbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708724.446638:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789708724.446643:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789708724.446706:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866bbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446720:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866bbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446733:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866baf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446739:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866baf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446755:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866baf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446761:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708724.446766:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866baf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446773:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866baf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446782:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:1.0:1789708724.446785:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708724.446789:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866baf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446795:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866baf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446820:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446826:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866bb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446832:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446837:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708724.446840:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446847:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446855:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a14148f3600) 00010000:00010000:1.0:1789708724.446857:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708724.446861:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866bb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446866:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866bb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446909:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c6866ba8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a62 expref: 44 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446925:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866bbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a62 expref: 43 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.446943:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:1.0:1789708724.446946:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708724.446948:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d22c00, rc 0) 00000100:00100000:1.0:1789708724.446989:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+43:11415:x1876645415816576:12345-192.168.202.53@tcp:101:stat.0 Request processed in 19144us (19378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708724.446997:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 154 00000100:00100000:1.0:1789708724.538852:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708724.538961:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415817216 00000100:00100000:2.0:1789708724.538973:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415817216 00000100:00100000:2.0:1789708724.539034:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 155 00000100:00100000:2.0:1789708724.539046:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+43:11421:x1876645415817216:12345-192.168.202.53@tcp:36:truncate.0 00010000:00010000:2.0:1789708724.539109:0:11601:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708724.539145:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866bbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a62 expref: 43 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.539168:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:2.0:1789708724.539174:0:11601:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708724.539410:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866bc4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.539423:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.539434:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789708724.539502:0:11601:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1789708724.539528:0:11601:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011fd23a6 reply state 00000000b4bb1dc4 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708724.539538:0:11601:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789708724.540065:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+45:11421:x1876645415817216:12345-192.168.202.53@tcp:36:truncate.0 Request processed in 1019us (1220us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789708724.540075:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 155 00000020:00080000:2.0:1789708724.540081:0:11601:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789708724.546944:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.546961:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866bc4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.546969:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866bc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.546989:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6be00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708724.546994:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866bc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.547001:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866bc4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.547016:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:0.0:1789708724.547019:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708724.547023:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866bc4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.547028:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866bc4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.668574:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708724.721903:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708724.722015:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415817344 00000100:00100000:2.0:1789708724.722026:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415817344 00000100:00100000:2.0:1789708724.722083:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 156 00000100:00100000:2.0:1789708724.722094:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+44:11435:x1876645415817344:12345-192.168.202.53@tcp:101:stat.0 00010000:00010000:2.0:1789708724.722119:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708724.722139:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866bcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a69 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722208:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866bd2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722223:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722246:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722262:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722288:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722295:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722376:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866be0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722383:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866be0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722388:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866be0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708724.722433:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789708724.722437:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789708724.722456:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866be0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722466:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866be0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722474:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722481:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866bd2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722486:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722501:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708724.722505:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722514:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866bd2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722527:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:2.0:1789708724.722529:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708724.722534:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866bd2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722548:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866bd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722561:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722566:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722571:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722575:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708724.722578:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722585:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722600:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1414c38400) 00010000:00010000:2.0:1789708724.722601:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708724.722604:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bd9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722609:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722638:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866bcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a69 expref: 46 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722697:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866be0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a69 expref: 45 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.722705:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:2.0:1789708724.722707:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708724.722710:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6ac00, rc 0) 00000100:00100000:2.0:1789708724.722781:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+45:11435:x1876645415817344:12345-192.168.202.53@tcp:101:stat.0 Request processed in 689us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708724.722789:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 156 00000100:00100000:3.0:1789708724.830427:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708724.830598:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415817600 00000100:00100000:1.0:1789708724.830608:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415817600 00000100:00100000:1.0:1789708724.830696:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 157 00000100:00100000:1.0:1789708724.830708:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+45:11445:x1876645415817600:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1789708724.830730:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708724.830761:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866be7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a70 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708724.830852:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789708724.830989:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866be7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a70 expref: 47 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.831006:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:1.0:1789708724.831009:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708724.831014:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6866be7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a70 expref: 47 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.831060:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4c00, rc 0) 00000100:00100000:1.0:1789708724.831131:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+46:11445:x1876645415817600:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 426us (714us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1789708724.831139:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 157 00000100:00100000:1.0:1789708724.837634:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708724.837759:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415817856 00000100:00100000:2.0:1789708724.837770:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415817856 00000100:00100000:2.0:1789708724.837830:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:2.0:1789708724.837839:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14069fac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+46:11445:x1876645415817856:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1789708724.838090:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14069fac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+47:11445:x1876645415817856:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 251us (465us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789708724.838100:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:0.0:1789708724.896450:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708724.896564:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415818112 00000100:00100000:2.0:1789708724.896576:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415818112 00000100:00100000:2.0:1789708724.896645:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 158 00000100:00100000:2.0:1789708724.896684:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+47:11451:x1876645415818112:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1789708724.896706:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708724.896728:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866bf5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a77 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.896867:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bfc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.896881:0:11601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866be0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a69 expref: 48 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.896891:0:11601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bfc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.896930:0:11601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866be0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a69 expref: 48 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.896944:0:11601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866be0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a69 expref: 48 pid: 5819 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708724.896957:0:11601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a140366ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11601:1876645426296320:192.168.202.53@tcp:104: 00000100:00100000:2.0:1789708724.897119:0:11601:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1307f32f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708724.900143:0:11601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a140366ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11601:1876645426296320:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708724.900171:0:11601:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bfc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708724.904101:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708724.904264:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415818240 00000100:00100000:1.0:1789708724.904274:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415818240 00010000:00010000:1.0:1789708724.904320:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866be0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a69 expref: 49 pid: 5819 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708724.904366:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 64 00000100:00100000:1.0:1789708724.904378:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+49:2362:x1876645415818240:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708724.904396:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708724.904403:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866be0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a69 expref: 49 pid: 5819 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.904415:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866be0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a69 expref: 49 pid: 5819 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.904440:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866be0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a69 expref: 49 pid: 5819 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.904459:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:1.0:1789708724.904465:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bfc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.904496:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.904506:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bfc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.904547:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708724.904616:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+48:2362:x1876645415818240:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 239us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708724.904625:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 64 00010000:00010000:2.0:1789708724.904842:0:11601:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.904851:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708724.904881:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789708724.905053:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866bf5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a77 expref: 49 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.905068:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bfc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a77 expref: 48 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.905077:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:2.0:1789708724.905080:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789708724.905083:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6b600, rc 0) 00000100:00100000:2.0:1789708724.905108:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+48:11451:x1876645415818112:12345-192.168.202.53@tcp:101:bash.0 Request processed in 8429us (8673us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1789708724.905115:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 158 00000100:00100000:3.0:1789708724.912883:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708724.915194:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415818496 00000100:00100000:0.0:1789708724.915221:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415818496 00000100:00100000:0.0:1789708724.915308:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 159 00000100:00100000:0.0:1789708724.915318:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+48:11451:x1876645415818496:12345-192.168.202.53@tcp:36:bash.0 00010000:00010000:0.0:1789708724.915577:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6866c0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.915597:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6866c0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708724.915609:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6866c0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789708724.915717:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1789708724.915750:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7b637a1 reply state 00000000e5b81672 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6866c0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708724.915759:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789708724.915875:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+51:11451:x1876645415818496:12345-192.168.202.53@tcp:36:bash.0 Request processed in 558us (3001us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1789708724.915883:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 159 00000020:00080000:0.0:1789708724.915889:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789708724.929441:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708724.930271:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415818624 00000100:00100000:3.0:1789708724.930284:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415818624 00000100:00100000:3.0:1789708724.930356:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 160 00000100:00100000:3.0:1789708724.930366:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+51:11451:x1876645415818624:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:3.0:1789708724.930394:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708724.930417:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866c11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a7e expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708724.930516:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866c18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708724.930532:0:7140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bfc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a77 expref: 52 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708724.930542:0:7140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6866c0a lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708724.930549:0:7140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866c18 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708724.930568:0:7140:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6866c0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708724.930595:0:7140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bfc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a77 expref: 52 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708724.930609:0:7140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bfc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a77 expref: 52 pid: 11601 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708724.930644:0:7140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7140:1876645426296448:192.168.202.53@tcp:104: 00000100:00100000:3.0:1789708724.932143:0:7140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1407e233c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789708724.932259:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6866c0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.932270:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6866c0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.932277:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6866c0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.932282:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22a00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708724.932287:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6866c0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.932295:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6866c0a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.932312:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:1.0:1789708724.932315:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708724.932318:0:3273:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866c18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.932348:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6866c0a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708724.932353:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6866c0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708724.949357:0:7140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7140:1876645426296448:192.168.202.53@tcp:104: 00010000:00010000:3.0:1789708724.949389:0:7140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866c18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708724.949597:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708724.949685:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415818752 00000100:00100000:2.0:1789708724.949692:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415818752 00010000:00010000:2.0:1789708724.949729:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bfc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a77 expref: 52 pid: 11601 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708724.949774:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 65 00000100:00100000:2.0:1789708724.949783:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+52:2361:x1876645415818752:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708724.949799:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708724.949820:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bfc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a77 expref: 52 pid: 11601 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.949833:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bfc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a77 expref: 52 pid: 11601 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.949857:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866bfc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a77 expref: 52 pid: 11601 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.949875:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:2.0:1789708724.949881:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866c18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.949892:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.949899:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866c18 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708724.949924:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708724.949995:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+51:2361:x1876645415818752:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 213us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708724.950003:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 65 00010000:00010000:3.0:1789708724.950063:0:7140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708724.950071:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708724.950118:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789708724.950123:0:7140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789708724.950141:0:7140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708724.950171:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866c11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a7e expref: 51 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708724.950186:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866c18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a7e expref: 50 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708724.950205:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:3.0:1789708724.950208:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708724.950210:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38600, rc 0) 00000100:00100000:3.0:1789708724.950242:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+50:11451:x1876645415818624:12345-192.168.202.53@tcp:101:bash.0 Request processed in 19877us (20810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708724.950254:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 160 00000100:00100000:1.0:1789708724.953254:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708724.953389:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415819008 00000100:00100000:2.0:1789708724.953400:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415819008 00000100:00100000:2.0:1789708724.953456:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:2.0:1789708724.953464:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+50:11451:x1876645415819008:12345-192.168.202.53@tcp:35:bash.0 00000100:00100000:2.0:1789708724.953733:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+51:11451:x1876645415819008:12345-192.168.202.53@tcp:35:bash.0 Request processed in 268us (488us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1789708724.953932:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:1.0:1789708725.034754:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708725.034846:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415819264 00000100:00100000:2.0:1789708725.034858:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415819264 00000100:00100000:2.0:1789708725.034923:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 161 00000100:00100000:2.0:1789708725.034933:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+51:11461:x1876645415819264:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708725.034960:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708725.034992:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866c1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a85 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708725.035368:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789708725.035531:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866c1f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a85 expref: 53 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.035547:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:2.0:1789708725.035551:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789708725.035556:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866c1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a85 expref: 53 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.035572:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6b600, rc 0) 00000100:00100000:2.0:1789708725.035687:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+52:11461:x1876645415819264:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 719us (916us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1789708725.035696:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 161 00000100:00100000:1.0:1789708725.062577:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708725.062717:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415819392 00000100:00100000:0.0:1789708725.062727:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415819392 00000100:00100000:0.0:1789708725.062790:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 162 00000100:00100000:0.0:1789708725.062798:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+52:11461:x1876645415819392:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:0.0:1789708725.062870:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866c2d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.062887:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866c2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.062898:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866c2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.062911:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866c34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.062919:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866c34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.062942:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866c34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.063034:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.063043:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.063050:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708725.063087:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.063099:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866c2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.063106:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866c2d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.063113:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866c2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.063119:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708725.064420:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866c2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.064438:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866c2d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.064453:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:0.0:1789708725.064466:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708725.064471:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866c2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.064478:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866c2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.064496:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866c34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.064503:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866c34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.064511:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866c34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.064517:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708725.064520:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866c34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.064525:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866c34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.064532:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a14148f3100) 00010000:00010000:0.0:1789708725.064535:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708725.064538:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866c34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.064543:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866c34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.064561:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.064572:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.064578:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.064583:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708725.064586:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.064593:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.064599:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:0.0:1789708725.064602:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708725.064605:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.064611:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708725.064713:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+52:11461:x1876645415819392:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 1912us (2141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708725.064723:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 162 00000100:00100000:2.0:1789708725.073623:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708725.074195:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415819648 00000100:00100000:0.0:1789708725.074209:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415819648 00000100:00100000:0.0:1789708725.074290:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:0.0:1789708725.074301:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+52:11461:x1876645415819648:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:0.0:1789708725.074591:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+53:11461:x1876645415819648:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 291us (982us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789708725.074611:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:3.0:1789708725.126600:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708725.126800:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415819904 00000100:00100000:2.0:1789708725.126812:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415819904 00000100:00100000:2.0:1789708725.126884:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 163 00000100:00100000:2.0:1789708725.126896:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+53:11464:x1876645415819904:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708725.126935:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708725.126958:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866c42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a8c expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127071:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866c49 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127088:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866c49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127101:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866c49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127116:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866c50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127124:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866c50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127131:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866c50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127266:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866c57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127275:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866c57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127282:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866c57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708725.127292:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789708725.127403:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866c49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127412:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866c49 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127419:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866c49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127425:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6bc00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708725.127430:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866c49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127437:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866c49 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127448:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:2.0:1789708725.127451:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708725.127456:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866c49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127462:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866c49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127474:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866c50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127481:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866c50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127487:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866c50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127493:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708725.127502:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866c50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127509:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866c50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127515:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1414c38400) 00010000:00010000:2.0:1789708725.127518:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708725.127521:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866c50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127527:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866c50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127572:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866c42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a8c expref: 56 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127586:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866c57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a8c expref: 55 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.127592:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:2.0:1789708725.127594:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708725.127597:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6b000, rc 0) 00000100:00100000:2.0:1789708725.127719:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+55:11464:x1876645415819904:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 826us (1129us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789708725.127727:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 163 00000100:00100000:1.0:1789708725.143079:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708725.143150:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708725.143335:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415820160 00000100:00100000:2.0:1789708725.143347:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415820160 00000100:00100000:2.0:1789708725.143421:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:2.0:1789708725.143433:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+55:2361:x1876645415820160:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708725.143470:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708725.143500:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866c57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a8c expref: 55 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.143520:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:2.0:1789708725.143525:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708725.143588:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+54:2361:x1876645415820160:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 158us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708725.143596:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:0.0:1789708725.144419:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415820032 00000100:00100000:0.0:1789708725.144429:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415820032 00000100:00100000:0.0:1789708725.144490:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 164 00000100:00100000:0.0:1789708725.144499:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+54:11464:x1876645415820032:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:0.0:1789708725.144562:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.144578:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.144588:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.144616:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.144624:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.144632:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.144640:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708725.144643:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.144677:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.144688:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:0.0:1789708725.144701:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789708725.144706:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.144713:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708725.144788:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+54:11464:x1876645415820032:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 290us (1722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708725.144796:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 164 00000100:00100000:1.0:1789708725.156095:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708725.156822:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415820416 00000100:00100000:0.0:1789708725.156834:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415820416 00000100:00100000:0.0:1789708725.156900:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:0.0:1789708725.156910:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+54:11464:x1876645415820416:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:0.0:1789708725.157159:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+55:11464:x1876645415820416:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 249us (1075us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789708725.157168:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:1.0:1789708725.406186:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708725.406338:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415820672 00000100:00100000:2.0:1789708725.406350:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415820672 00000100:00100000:2.0:1789708725.406422:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 165 00000100:00100000:2.0:1789708725.406433:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+55:11482:x1876645415820672:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:2.0:1789708725.406464:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708725.406491:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866c6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a93 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.406613:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866c73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.406630:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866c73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.406645:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866c73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708725.406716:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789708725.406870:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866c6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a93 expref: 58 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.406906:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866c73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a93 expref: 57 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.406915:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:2.0:1789708725.406918:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789708725.406921:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6b600, rc 0) 00000100:00100000:2.0:1789708725.411827:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+57:11482:x1876645415820672:12345-192.168.202.53@tcp:101:cat.0 Request processed in 5241us (5498us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789708725.411844:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 165 00000100:00100000:1.0:1789708725.460428:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708725.460598:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415820800 00000100:00100000:0.0:1789708725.460609:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415820800 00000100:00100000:0.0:1789708725.460704:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 166 00000100:00100000:0.0:1789708725.460715:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+57:11483:x1876645415820800:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1789708725.460753:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708725.460779:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4a9a expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.460845:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866c88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.460859:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.460883:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708725.460917:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789708725.460919:0:11601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789708725.460934:0:11601:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.460957:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a9a expref: 59 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.460976:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866c88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a9a expref: 58 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.460984:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:0.0:1789708725.460987:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708725.460991:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23600, rc 0) 00000100:00100000:0.0:1789708725.461055:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+58:11483:x1876645415820800:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 343us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708725.461062:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 166 00000100:00100000:1.0:1789708725.470577:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708725.471292:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415821184 00000100:00100000:0.0:1789708725.471306:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415821184 00000100:00100000:0.0:1789708725.471376:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 48 00000100:00100000:0.0:1789708725.471387:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+58:11483:x1876645415821184:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:0.0:1789708725.471781:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+59:11483:x1876645415821184:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 394us (1214us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789708725.471790:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 48 00000100:00100000:3.0:1789708725.476543:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708725.476731:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415821312 00000100:00100000:2.0:1789708725.476753:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415821312 00000100:00100000:2.0:1789708725.476823:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:2.0:1789708725.476835:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+59:11483:x1876645415821312:12345-192.168.202.53@tcp:103:lfs.0 00010000:00010000:2.0:1789708725.476862:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789708725.476891:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866c18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a7e expref: 59 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.476918:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b600/0xa8f741d1c6866c73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a93 expref: 58 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.476931:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866b23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a3f expref: 57 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.476941:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4600) 00010000:00010000:2.0:1789708725.476952:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708725.477033:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+56:11483:x1876645415821312:12345-192.168.202.53@tcp:103:lfs.0 Request processed in 200us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708725.477042:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:1.0:1789708725.491185:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708725.491316:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415821440 00000100:00100000:0.0:1789708725.491327:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415821440 00000100:00100000:0.0:1789708725.491406:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 167 00000100:00100000:0.0:1789708725.491416:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+56:11483:x1876645415821440:12345-192.168.202.53@tcp:58:lfs.0 00010000:00010000:0.0:1789708725.491545:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c8f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.491561:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.491575:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708725.491852:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789708725.491940:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+56:11483:x1876645415821440:12345-192.168.202.53@tcp:58:lfs.0 Request processed in 525us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708725.491949:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 167 00000100:00100000:2.0:1789708725.541288:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708725.541407:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415821568 00000100:00100000:3.0:1789708725.541417:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415821568 00000100:00100000:3.0:1789708725.541469:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 168 00000100:00100000:3.0:1789708725.541479:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+56:11485:x1876645415821568:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1789708725.541503:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708725.541526:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866c96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4aa1 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.541591:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866c9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.541606:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866c9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.541617:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866c9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.541632:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.541639:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.541645:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542007:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866cab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542024:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866cab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542032:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866cab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708725.542069:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789708725.542073:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789708725.542092:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866cab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542104:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866cab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542113:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866c9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542119:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866c9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542126:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866c9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542132:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708725.542136:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866c9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542144:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866c9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542156:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:3.0:1789708725.542159:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708725.542170:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866c9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542176:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866c9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542188:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542194:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ca4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542200:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542205:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708725.542208:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542214:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542289:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1411b4ab00) 00010000:00010000:3.0:1789708725.542292:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708725.542295:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ca4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542300:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ca4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542328:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866c96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4aa1 expref: 58 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542351:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866cab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4aa1 expref: 57 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.542357:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3100) 00010000:00010000:3.0:1789708725.542359:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789708725.542361:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38c00, rc 0) 00000100:00100000:3.0:1789708725.542415:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+57:11485:x1876645415821568:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 940us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708725.542422:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 168 00000001:00080000:2.0:1789708725.574920:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:2.0:1789708725.574990:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789708725.575019:0:5841:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a1307f32cc0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789708725.575024:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a143f258d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a1307f32000 00000020:00080000:2.0:1789708725.575027:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a143f258800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a1306c8c000 00000020:00080000:2.0:1789708725.575069:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1789708725.575571:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426296576:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789708725.575675:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1789708725.575844:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1789708725.575993:0:11993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426296576 00000100:00100000:1.0:1789708725.576002:0:11993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426296576 00000100:00100000:1.0:1789708725.576067:0:11993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789708725.576076:0:11993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426296576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789708725.576104:0:11993:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1789708725.576136:0:11993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aacc9b3, atime: 0x6aacc9b3, ctime: 0x6aacc9b3, blocks: 0xb 00010000:00010000:1.0:1789708725.576144:0:11993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c6866cb2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708725.576162:0:11993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=291s v=(0 0) 00010000:00010000:1.0:1789708725.576166:0:11993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708725.576186:0:11993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c6866cb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708725.576212:0:11993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c6866cb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708725.576335:0:11993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c6866cb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708725.576344:0:11993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c6866cb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708725.576367:0:11993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789708725.576903:0:11993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3286:x1876645426296576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 827us (1226us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789708725.576911:0:11993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1789708725.576990:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708725.576997:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c6866cb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.577006:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5800 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708725.577011:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c6866cb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.577021:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c6866cb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.577047:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c6866cb2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.577055:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c6866cb2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.577075:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708725.577076:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708725.577078:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708725.577109:0:3286:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1789708725.577114:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1789708725.577140:0:3286:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a143e958a80 x1876645426296576/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789708741 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789708725.577153:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a143e958a80/2, rc 0, transno 4294967307 00000100:00100000:0.0:1789708725.577158:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426296576:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1789708725.581533:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1789708725.692198:0:11657:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789708725.692207:0:11657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789708725.692271:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789708725.692284:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789708725.692417:0:11657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308bd9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11657:1876645426296704:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789708725.692527:0:11657:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308463f00 going to sleep for 11 seconds 00010000:00010000:0.0:1789708725.692946:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708725.695833:0:11657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308bd9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11657:1876645426296704:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789708725.708129:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708725.708204:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415821696 00000100:00100000:0.0:1789708725.708216:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415821696 00000100:00100000:0.0:1789708725.708285:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 169 00000100:00100000:0.0:1789708725.708294:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+16:11496:x1876645415821696:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789708725.708335:0:5820:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789708725.708469:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+16:11496:x1876645415821696:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 175us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708725.708477:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 169 00000100:00100000:3.0:1789708725.738971:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708725.749898:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415821824 00000100:00100000:2.0:1789708725.749914:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415821824 00000100:00100000:2.0:1789708725.749985:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 170 00000100:00100000:2.0:1789708725.749994:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+16:11496:x1876645415821824:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789708725.750063:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866cb9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750082:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866cb9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750095:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866cb9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750130:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866cc0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750156:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750164:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750192:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866cc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750200:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750207:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708725.750247:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789708725.750251:0:7140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789708725.750264:0:7140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750275:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866cb9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750282:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866cb9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750289:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866cb9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750296:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708725.750300:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866cb9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750316:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866cb9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750328:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1411b4a700) 00010000:00010000:2.0:1789708725.750331:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708725.750335:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866cb9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750341:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866cb9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750356:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750363:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866cc0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750370:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750375:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708725.750378:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750384:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866cc0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750391:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8a1414c38100) 00010000:00010000:2.0:1789708725.750394:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708725.750396:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866cc0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750412:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866cc0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750427:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750433:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866cc7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750439:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750444:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6bc00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708725.750447:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750453:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750460:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3100) 00010000:00010000:2.0:1789708725.750462:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708725.750465:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866cc7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.750472:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866cc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708725.750568:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+16:11496:x1876645415821824:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 Request processed in 574us (11606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708725.750576:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 170 00000100:00100000:0.0:1789708725.754048:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708725.754162:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415822080 00000100:00100000:2.0:1789708725.754175:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415822080 00000100:00100000:2.0:1789708725.754227:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 171 00000100:00100000:2.0:1789708725.754237:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+16:11496:x1876645415822080:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708725.754259:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708725.754281:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866cce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4aa8 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.754389:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866cd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.754403:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.754413:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708725.754424:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789708725.754621:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.754629:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866cd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.754636:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.754642:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6be00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708725.754646:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.754692:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866cd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.754722:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3100) 00010000:00010000:2.0:1789708725.754725:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708725.754730:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866cd5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.754747:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866cd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.754794:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866cce lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4aa8 expref: 18 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.754805:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1411b4a700) 00010000:00010000:2.0:1789708725.754808:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789708725.754812:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866cce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4aa8 expref: 18 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708725.754822:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6ac00, rc 0) 00000100:00100000:2.0:1789708725.754890:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+17:11496:x1876645415822080:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 654us (855us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1789708725.754898:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 171 00000100:00100000:1.0:1789708725.763285:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708725.763380:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415822208 00000100:00100000:2.0:1789708725.763391:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415822208 00000100:00100000:2.0:1789708725.763450:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 172 00000100:00100000:2.0:1789708725.763461:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+17:11496:x1876645415822208:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789708725.763500:0:5821:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789708725.763623:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+17:11496:x1876645415822208:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 164us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708725.763640:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 172 00000100:00100000:3.0:1789708725.781916:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708725.782535:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415822464 00000100:00100000:0.0:1789708725.782546:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415822464 00000100:00100000:0.0:1789708725.782604:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 173 00000100:00100000:0.0:1789708725.782615:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+17:11496:x1876645415822464:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708725.782637:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708725.782640:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789708725.782685:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866c88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a9a expref: 17 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.782703:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:0.0:1789708725.782708:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708725.782720:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6866ce3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4aaf expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789708725.783425:0:5819:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1789708725.783751:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866cea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.783767:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.783789:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.783851:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6866ce3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4aaf expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.783868:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866cea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4aaf expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.783877:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a14148f3900) 00010000:00010000:0.0:1789708725.783879:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708725.783883:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23200, rc 0) 00000100:00100000:0.0:1789708725.783951:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+18:11496:x1876645415822464:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 1337us (2049us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789708725.783959:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 173 00000100:00100000:0.0:1789708725.787882:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708725.787972:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415822720 00000100:00100000:3.0:1789708725.787982:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415822720 00000100:00100000:3.0:1789708725.788046:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 174 00000100:00100000:3.0:1789708725.788057:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+18:11496:x1876645415822720:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789708725.788132:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708725.788161:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866cea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4aaf expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788182:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a14148f3900) 00010000:00010000:3.0:1789708725.788193:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708725.788215:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866cf8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788229:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866cf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788258:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866cf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788315:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866cff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xaf50c8c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788322:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866cff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xaf50c8c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788328:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866cff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xaf50c8c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788546:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866cf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788554:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866cf8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788561:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866cf8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788567:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708725.788571:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866cf8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788580:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866cf8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788587:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:3.0:1789708725.788590:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708725.788594:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866cf8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788605:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866cf8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788615:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866cff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xaf50c8c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788621:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866cff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaf50c8c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788627:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866cff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaf50c8c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788632:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708725.788635:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866cff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaf50c8c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788641:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866cff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaf50c8c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788679:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xaf50c8c6 (ffff8a1411b4a100) 00010000:00010000:3.0:1789708725.788682:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708725.788685:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866cff lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xaf50c8c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.788691:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866cff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xaf50c8c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708725.788786:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+17:11496:x1876645415822720:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 729us (913us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789708725.788794:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 174 00000100:00100000:0.0:1789708725.795962:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708725.796033:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415822848 00000100:00100000:3.0:1789708725.796044:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415822848 00000100:00100000:3.0:1789708725.796102:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 175 00000100:00100000:3.0:1789708725.796111:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+17:11496:x1876645415822848:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708725.796133:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708725.796155:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866d06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4ab6 expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.796190:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866d0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.796205:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866d0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.796216:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866d0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.796319:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866d06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ab6 expref: 19 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.796334:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866d0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ab6 expref: 18 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.796343:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1411b4ab00) 00010000:00010000:3.0:1789708725.796346:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789708725.796349:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38600, rc 0) 00000100:00100000:3.0:1789708725.796419:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+18:11496:x1876645415822848:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 308us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708725.796426:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 175 00000100:00100000:3.0:1789708725.800982:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708725.803822:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415823104 00000100:00100000:0.0:1789708725.803839:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415823104 00000100:00100000:0.0:1789708725.803919:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 176 00000100:00100000:0.0:1789708725.803930:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+18:11496:x1876645415823104:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789708725.804054:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866d14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.804072:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866d14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.804094:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866d14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708725.804410:0:11601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1789708725.804421:0:11601:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 291601770294ns, next at 292601767417ns, rc = 0 00000004:00010000:0.0:1789708725.804518:0:11601:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fb96cb1 reply state 000000000a3d3546 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866d14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708725.804528:0:11601:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789708725.804647:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+20:11496:x1876645415823104:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 717us (3678us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1789708725.804676:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 176 00010000:00010000:0.0:1789708725.810709:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866d14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.810726:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866d14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.810744:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866d14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.810752:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708725.810757:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866d14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.810766:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866d14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.810783:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1411b4ab00) 00010000:00010000:0.0:1789708725.810786:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789708725.810804:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866d14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.810811:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22c00/0xa8f741d1c6866d14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708725.815547:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708725.815590:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415823232 00000100:00100000:3.0:1789708725.815601:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415823232 00000100:00100000:3.0:1789708725.815669:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 177 00000100:00100000:3.0:1789708725.815680:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+19:11496:x1876645415823232:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708725.815706:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708725.815725:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866d1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4abd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.815809:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866d1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4abd expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.815823:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866d1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4abd expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708725.815843:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1411b4ab00) 00010000:00010000:3.0:1789708725.815847:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789708725.815850:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38200, rc 0) 00000100:00100000:3.0:1789708725.815906:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+20:11496:x1876645415823232:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 229us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708725.815914:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 177 00000100:00100000:3.0:1789708725.821376:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708725.821436:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415823360 00000100:00100000:3.0:1789708725.821446:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415823360 00000100:00100000:3.0:1789708725.821509:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:3.0:1789708725.821520:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2362:x1876645415823360:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789708725.821909:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2362:x1876645415823360:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 390us (540us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789708725.821917:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00080000:3.0:1789708725.821938:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789708725.836426:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708725.836778:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415823616 00000100:00100000:2.0:1789708725.836800:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415823616 00000100:00100000:2.0:1789708725.836884:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:2.0:1789708725.836897:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+20:11496:x1876645415823616:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789708725.837179:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+21:11496:x1876645415823616:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 284us (766us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789708725.837187:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:3.0:1789708725.838996:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708725.841895:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415823872 00000100:00100000:1.0:1789708725.841913:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415823872 00000100:00100000:1.0:1789708725.841985:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 178 00000100:00100000:1.0:1789708725.841995:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+21:11496:x1876645415823872:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789708725.842135:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+21:11496:x1876645415823872:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 140us (3147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708725.842143:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 178 00000100:00100000:0.0:1789708725.852523:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708725.852781:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415824000 00000100:00100000:1.0:1789708725.852793:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415824000 00000100:00100000:1.0:1789708725.852861:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 179 00000100:00100000:1.0:1789708725.852882:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+21:11496:x1876645415824000:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708725.852905:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708725.852929:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866d22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4ac4 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708725.853040:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866d29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708725.853055:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866d29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708725.853071:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866d29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708725.853109:0:11601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789708725.853127:0:11601:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866d29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708725.853162:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866d22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ac4 expref: 23 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708725.854913:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866d29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ac4 expref: 22 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708725.854929:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1411b4ab00) 00010000:00010000:1.0:1789708725.854932:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789708725.854936:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4600, rc 0) 00000100:00100000:3.0:1789708725.855516:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+22:11496:x1876645415824000:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 2633us (2997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708725.855526:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 179 00000100:00100000:3.0:1789708725.858878:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708725.859780:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415824128 00000100:00100000:0.0:1789708725.859794:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415824128 00000100:00100000:0.0:1789708725.859871:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:0.0:1789708725.859882:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2364:x1876645415824128:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708725.859903:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708725.859952:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866d30 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4acb expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708725.859988:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aacc9b6, blocks: 0x1 00010000:00010000:0.0:1789708725.860014:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=291s v=(0 0) 00010000:00010000:0.0:1789708725.860019:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708725.860028:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866d30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4acb expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.860045:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866d30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4acb expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.860060:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23600, rc 0) 00000100:00100000:0.0:1789708725.860142:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2364:x1876645415824128:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 262us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708725.860149:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:0.0:1789708725.874950:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708725.875053:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415824384 00000100:00100000:3.0:1789708725.875064:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415824384 00000100:00100000:3.0:1789708725.875132:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 180 00000100:00100000:3.0:1789708725.875142:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+22:11496:x1876645415824384:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789708725.875279:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+22:11496:x1876645415824384:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 137us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708725.875287:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 180 00000100:00100000:3.0:1789708725.880007:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708725.880100:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415824512 00000100:00100000:0.0:1789708725.880111:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415824512 00000100:00100000:0.0:1789708725.880171:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:0.0:1789708725.880181:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+8:11496:x1876645415824512:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708725.880211:0:10424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708725.880230:0:10424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6866d37 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4ad2 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.880265:0:10424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866d30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4acb expref: 9 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.880273:0:10424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708725.880279:0:10424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708725.880284:0:10424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6866d37 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ad2 expref: 9 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.880320:0:10424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866d30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4acb expref: 9 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.880332:0:10424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866d30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4acb expref: 9 pid: 6673 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708725.880346:0:10424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f510e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10424:1876645426296832:192.168.202.53@tcp:104: 00000100:00100000:0.0:1789708725.880450:0:10424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308463f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708725.899055:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708725.899182:0:10424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f510e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10424:1876645426296832:192.168.202.53@tcp:104: 00000100:00100000:1.0:1789708725.899208:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415824640 00000100:00100000:1.0:1789708725.899218:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415824640 00010000:00010000:0.0:1789708725.899240:0:10424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6866d37 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ad2 expref: 10 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708725.899261:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866d30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4acb expref: 10 pid: 6673 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708725.899264:0:10424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23a00, rc 0) 00000100:00100000:1.0:1789708725.899311:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00100000:1.0:1789708725.899323:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+10:2362:x1876645415824640:12345-192.168.202.53@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789708725.899334:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+10:11496:x1876645415824512:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 19153us (19337us total) trans 0 rc 0/0 00010000:00010000:1.0:1789708725.899340:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789708725.899345:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 53 00010000:00010000:1.0:1789708725.899371:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866d30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4acb expref: 9 pid: 6673 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708725.899388:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866d30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4acb expref: 9 pid: 6673 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708725.899416:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866d30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4acb expref: 9 pid: 6673 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708725.899434:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708725.899439:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708725.899448:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6866d37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ad2 expref: 8 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708725.899459:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6866d37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ad2 expref: 8 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708725.899497:0:5805:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6866d37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ad2 expref: 8 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708725.899513:0:5805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130a1ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5805:1876645426296960:192.168.202.53@tcp:105: 00000100:00100000:1.0:1789708725.899582:0:5805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a141095c600 going to sleep for 11 seconds 00000100:00100000:1.0:1789708725.911161:0:5805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130a1ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5805:1876645426296960:192.168.202.53@tcp:105: 00010000:00010000:1.0:1789708725.911191:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708725.911253:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2362:x1876645415824640:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 11931us (12208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708725.911266:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00100000:2.0:1789708725.918119:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708725.922878:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415824768 00000100:00100000:0.0:1789708725.922894:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415824768 00002000:00100000:0.0:1789708725.922971:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8a143f53fb80 x1876645415824768/t0(0) o4->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:111/0 lens 504/0 e 0 to 0 dl 1789708736 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789708725.922984:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a143f53fb80 with x1876645415824768 ext(0->8) 00002000:00010000:0.0:1789708725.922990:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a143f53fb80 00000100:00100000:0.0:1789708725.923032:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:0.0:1789708725.923043:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2363:x1876645415824768:12345-192.168.202.53@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789708725.923905:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+10:2363:x1876645415824768:12345-192.168.202.53@tcp:4:lhsmtool_posix.0 Request processed in 860us (5793us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789708725.923916:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00002000:00100000:0.0:1789708725.923925:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8a143f53fb80 x1876645415824768/t4294967314(0) o4->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:111/0 lens 504/448 e 0 to 0 dl 1789708736 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789708725.923933:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a143f53fb80 with x1876645415824768 ext(0->8) 00002000:00010000:0.0:1789708725.923937:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a143f53fb80 00000100:00100000:3.0:1789708725.931131:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708725.931244:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415824896 00000100:00100000:0.0:1789708725.931257:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415824896 00000100:00100000:0.0:1789708725.931335:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 181 00000100:00100000:0.0:1789708725.931345:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+22:11496:x1876645415824896:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789708726.024243:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1789708726.024259:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:3.0:1789708726.024278:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1789708726.024287:0:5841:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1789708726.024420:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1789708726.024430:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789708726.024447:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130a5aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426297088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789708726.024528:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708726.024607:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426297088 00000100:00100000:3.0:1789708726.024614:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426297088 00000100:00100000:3.0:1789708726.024699:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789708726.024708:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426297088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789708726.024883:0:6670:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789708726.024886:0:6670:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789708726 00002000:00010000:3.0:1789708726.024889:0:6670:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789708726.024891:0:6670:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789708726 -> 1789708726 00002000:00010000:3.0:1789708726.024893:0:6670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789708726.024935:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3287:x1876645426297088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 228us (407us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789708726.024942:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1789708726.024963:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789708726.024992:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a130a5aca80/2, rc 0, transno 4294967315 00000100:00100000:3.0:1789708726.024997:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130a5aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426297088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789708726.025584:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+18:11496:x1876645415824896:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 Request processed in 94237us (94467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708726.025594:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 181 00000100:00100000:3.0:1789708726.030330:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708726.034099:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415825024 00000100:00100000:2.0:1789708726.034115:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415825024 00000100:00100000:3.0:1789708726.034283:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:3.0:1789708726.034296:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+10:2361:x1876645415825024:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789708726.126795:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+10:2361:x1876645415825024:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 Request processed in 91994us (95966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708726.126813:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 55 00000001:00080000:3.0:1789708726.126859:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:3.0:1789708726.126877:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1789708726.139846:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708726.142392:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415825280 00000100:00100000:3.0:1789708726.142408:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415825280 00000100:00100000:3.0:1789708726.142520:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 182 00000100:00100000:3.0:1789708726.142532:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+18:11496:x1876645415825280:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789708726.142593:0:11601:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708726.142623:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866d29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ac4 expref: 18 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.142640:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1411b4ab00) 00010000:00010000:3.0:1789708726.142645:0:11601:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708726.142697:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866d3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.142712:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866d3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.142722:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866d3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708726.143011:0:11601:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000093e8d4 reply state 000000002fee7eb8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866d3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708726.143020:0:11601:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789708726.143131:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+19:11496:x1876645415825280:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 601us (3293us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789708726.143139:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 182 00000100:00080000:2.0:1789708726.144472:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789708726.150332:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866d3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708726.150341:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00010000:00010000:0.0:1789708726.150347:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866d3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.150355:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866d3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.150363:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708726.150370:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866d3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.150377:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866d3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.150396:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1411b4ab00) 00010000:00010000:0.0:1789708726.150400:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708726.150405:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866d3e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.150410:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866d3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708726.150452:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415825408 00000100:00100000:0.0:1789708726.150462:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415825408 00000100:00100000:0.0:1789708726.150542:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:0.0:1789708726.150552:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2362:x1876645415825408:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789708726.150858:0:10424:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789708726.150861:0:10424:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789708726 -> 1789708725 00002000:00010000:0.0:1789708726.150864:0:10424:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789708723 00002000:00010000:0.0:1789708726.150866:0:10424:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789708726 -> 1789708725 00002000:00010000:0.0:1789708726.150868:0:10424:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789708726.150924:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2362:x1876645415825408:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 374us (591us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789708726.150931:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:0.0:1789708726.160130:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708726.160897:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415825664 00000100:00100000:1.0:1789708726.160909:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415825664 00000100:00100000:1.0:1789708726.160990:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 183 00000100:00100000:1.0:1789708726.161001:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+18:11496:x1876645415825664:12345-192.168.202.53@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789708726.161095:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.161112:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866d0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ab6 expref: 18 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.161121:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d45 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.161160:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866d0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ab6 expref: 18 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.161176:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866d0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ab6 expref: 18 pid: 7140 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708726.161191:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130a1ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1876645426297216:192.168.202.53@tcp:104: 00000100:00100000:1.0:1789708726.161830:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14051bb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708726.173968:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708726.177352:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415825792 00000100:00100000:2.0:1789708726.177369:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415825792 00010000:00010000:2.0:1789708726.177417:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866d0d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ab6 expref: 19 pid: 7140 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708726.177467:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 67 00000100:00100000:2.0:1789708726.177477:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+19:2361:x1876645415825792:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708726.177491:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708726.177498:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866d0d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ab6 expref: 19 pid: 7140 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708726.177511:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866d0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ab6 expref: 19 pid: 7140 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708726.177542:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1411b4ab00) 00010000:00010000:2.0:1789708726.177547:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708726.177557:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708726.177564:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d45 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708726.177583:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708726.177644:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+19:2361:x1876645415825792:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 168us (3689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708726.177673:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 67 00010000:00010000:0.0:1789708726.177870:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866d0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ab6 expref: 18 pid: 7140 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708726.177886:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130a1ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1876645426297216:192.168.202.53@tcp:104: 00010000:00010000:0.0:1789708726.177908:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.177917:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.177923:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.177955:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.177962:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.177975:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.177982:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708726.177987:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.177996:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d45 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.178005:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1411b4ab00) 00010000:00010000:0.0:1789708726.178008:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789708726.178012:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d45 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.178018:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708726.178063:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+17:11496:x1876645415825664:12345-192.168.202.53@tcp:55:lhsmtool_posix.0 Request processed in 17063us (17942us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789708726.178071:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 183 00000100:00100000:1.0:1789708726.185000:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708726.185381:0:11993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415825920 00000100:00100000:0.0:1789708726.185393:0:11993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415825920 00000100:00100000:0.0:1789708726.185457:0:11993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:0.0:1789708726.185468:0:11993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2363:x1876645415825920:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789708726.185520:0:11993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6866d4c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.185539:0:11993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6866d37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ad2 expref: 8 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.185555:0:11993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708726.185560:0:11993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789708726.185565:0:11993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6866d4c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.185603:0:11993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6866d37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ad2 expref: 8 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.185617:0:11993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6866d37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ad2 expref: 8 pid: 10424 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708726.185631:0:11993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f512680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11993:1876645426297344:192.168.202.53@tcp:104: 00000100:00100000:0.0:1789708726.185745:0:11993:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308463480 going to sleep for 11 seconds 00000100:00100000:0.0:1789708726.190544:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708726.190585:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415826048 00000100:00100000:0.0:1789708726.190594:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415826048 00010000:00010000:0.0:1789708726.190640:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6866d37 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ad2 expref: 9 pid: 10424 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708726.190704:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 68 00000100:00100000:0.0:1789708726.190714:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1407f55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+9:2362:x1876645415826048:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708726.190741:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708726.190768:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6866d37 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ad2 expref: 9 pid: 10424 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.190803:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6866d37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ad2 expref: 9 pid: 10424 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.190831:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789708726.190836:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789708726.190841:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6866d4c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.190850:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6866d4c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.190871:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708726.190928:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1407f55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+9:2362:x1876645415826048:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 216us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708726.190935:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 68 00010000:00010000:3.0:1789708726.191629:0:11993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6866d37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ad2 expref: 8 pid: 10424 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708726.191674:0:11993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f512680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11993:1876645426297344:192.168.202.53@tcp:104: 00010000:00010000:3.0:1789708726.191694:0:11993:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6866d4c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.191714:0:11993:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6866d4c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.191721:0:11993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6866d4c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.191758:0:11993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6866d4c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.191766:0:11993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6866d4c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.191773:0:11993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6866d4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.191780:0:11993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22e00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708726.191784:0:11993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6866d4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.191794:0:11993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6866d4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.191808:0:11993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6866d4c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.191826:0:11993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6866d4c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708726.191887:0:11993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2363:x1876645415825920:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 Request processed in 6420us (6897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708726.191895:0:11993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:0.0:1789708726.204382:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708726.208329:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415826304 00000100:00100000:2.0:1789708726.208346:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415826304 00000100:00100000:2.0:1789708726.208415:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 184 00000100:00100000:2.0:1789708726.208425:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+17:11496:x1876645415826304:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789708726.208510:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866d53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708726.208529:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866d53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708726.208542:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866d53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708726.208781:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866d5a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708726.208809:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866d1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4abd expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708726.208817:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866d5a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708726.208855:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866d1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4abd expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708726.208868:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866d1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4abd expref: 18 pid: 5821 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708726.208883:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f53ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1876645426297472:192.168.202.53@tcp:104: 00000100:00100000:2.0:1789708726.210106:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1307f32f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708726.217524:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708726.217606:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415826432 00000100:00100000:3.0:1789708726.217618:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415826432 00010000:00010000:3.0:1789708726.217679:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866d1b lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4abd expref: 19 pid: 5821 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708726.217719:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:3.0:1789708726.217740:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+19:2361:x1876645415826432:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708726.217759:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708726.217766:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866d1b lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4abd expref: 19 pid: 5821 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.217778:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866d1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4abd expref: 19 pid: 5821 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.217802:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1411b4ab00) 00010000:00010000:3.0:1789708726.217808:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866d5a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.217816:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866d5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.217836:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866d5a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.217856:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708726.217913:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+19:2361:x1876645415826432:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 184us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708726.217921:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 69 00010000:00010000:0.0:1789708726.218257:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866d1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4abd expref: 18 pid: 5821 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708726.218274:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f53ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1876645426297472:192.168.202.53@tcp:104: 00010000:00010000:0.0:1789708726.218295:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866d5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.218305:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866d5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.218322:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866d5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789708726.218531:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1789708726.218740:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1789708726.218791:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1789708726.218896:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f512680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5820:1876645426297600:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789708726.219042:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708726.219074:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308463480 going to sleep for 11 seconds 00000100:00100000:2.0:1789708726.219203:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426297600 00000100:00100000:2.0:1789708726.219210:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426297600 00000100:00100000:2.0:1789708726.224556:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789708726.224586:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5820:x1876645426297600:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789708726.224749:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5820:x1876645426297600:12345-0@lo:1000:mdt00_001.0 Request processed in 180us (5707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708726.224758:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708726.224881:0:5820:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1789708726.224888:0:5820:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a130a5aca80, transno 4294967315 00000100:00100000:0.0:1789708726.224903:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f512680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5820:1876645426297600:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789708726.225439:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1789708726.225519:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308bd9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5820:1876645426297728:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789708726.225569:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708726.229527:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140319f480 going to sleep for 11 seconds 00000100:00100000:1.0:1789708726.231204:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426297728 00000100:00100000:1.0:1789708726.231220:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426297728 00000100:00100000:0.0:1789708726.232904:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789708726.232917:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5820:x1876645426297728:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789708726.233270:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5820:x1876645426297728:12345-0@lo:1000:mdt00_001.0 Request processed in 355us (7700us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789708726.233279:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789708726.233341:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308bd9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5820:1876645426297728:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789708726.233389:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866d5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.233400:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866d5a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.233417:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866d5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.233423:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6be00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708726.233427:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866d5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.233436:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866d5a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.233454:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a1411b4ab00) 00010000:00010000:0.0:1789708726.233457:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708726.233462:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866d5a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.233468:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866d5a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.233507:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.233513:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c8f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.233518:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c8f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.233523:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708726.233526:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c8f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.233541:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c8f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.233549:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3100) 00010000:00010000:0.0:1789708726.233551:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708726.233554:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c8f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.233560:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866c8f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.233591:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866d61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.233605:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866cab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4aa1 expref: 21 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.233613:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866d61 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.233672:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866cab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4aa1 expref: 21 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.233685:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866cab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4aa1 expref: 21 pid: 5819 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708726.233700:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e95b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1876645426297856:192.168.202.53@tcp:104: 00000100:00100000:0.0:1789708726.233791:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308463a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708726.241577:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708726.241812:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e95b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1876645426297856:192.168.202.53@tcp:104: 00010000:00010000:1.0:1789708726.241845:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866d61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708726.242870:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415826560 00000100:00100000:3.0:1789708726.242883:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415826560 00010000:00010000:3.0:1789708726.242931:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866cab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4aa1 expref: 22 pid: 5819 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708726.242988:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 70 00000100:00100000:3.0:1789708726.242999:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+22:2362:x1876645415826560:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708726.243018:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708726.243026:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866cab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4aa1 expref: 22 pid: 5819 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.243041:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866cab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4aa1 expref: 22 pid: 5819 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.243067:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866cab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4aa1 expref: 22 pid: 5819 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.243094:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3100) 00010000:00010000:3.0:1789708726.243100:0:8435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866d61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.243123:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866d61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.243132:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866d61 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708726.243167:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708726.243258:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+21:2362:x1876645415826560:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 260us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708726.243267:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 70 00010000:00010000:1.0:1789708726.244442:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866d61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.244455:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866d61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.244469:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866d61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.244476:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866d61 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.244483:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866d61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.244489:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708726.244493:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866d61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.244500:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866d61 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.244510:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3100) 00010000:00010000:1.0:1789708726.244519:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708726.244523:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866d61 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.244527:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866d61 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.244537:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866d53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.244540:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866d53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.244544:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866d53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.244547:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6bc00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708726.244549:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866d53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.244552:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866d53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.244556:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3100) 00010000:00010000:1.0:1789708726.244558:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789708726.244559:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866d53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.244562:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866d53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708726.244815:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+20:11496:x1876645415826304:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 36388us (40443us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1789708726.244832:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 184 00000020:00080000:1.0:1789708726.244838:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789708726.245016:0:11657:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789708726.245021:0:11657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789708726.245457:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1789708726.245472:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789708726.249274:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708726.259200:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415826816 00000100:00100000:3.0:1789708726.259216:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415826816 00000100:00100000:0.0:1789708726.260497:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:0.0:1789708726.260517:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14069f9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+20:11496:x1876645415826816:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789708726.261231:0:5823:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789708726.261356:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1789708726.261405:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866d68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.261422:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866d68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.261435:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866d68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.261445:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866d68 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.261451:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866d68 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.261458:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866d68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.261483:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789708726.261597:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14069f9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+22:11496:x1876645415826816:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 1080us (12331us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1789708726.261606:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 50 00000020:00080000:0.0:1789708726.261612:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789708726.261681:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708726.261687:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866d68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.261693:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22600 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708726.261703:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866d68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.261712:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866d68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.261724:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a14148f3900) 00010000:00010000:0.0:1789708726.261735:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789708726.261740:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866d68 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.261746:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866d68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.261765:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708726.261767:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708726.261768:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708726.520316:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708726.520373:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708726.520412:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708726.520442:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415827200 00000100:00100000:3.0:1789708726.520456:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415827200 00000100:00100000:3.0:1789708726.520530:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 113 00000100:00100000:3.0:1789708726.520541:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c9d2a103-cf70-4470-bdd0-387470668318+5:2363:x1876645415827200:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708726.520617:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c9d2a103-cf70-4470-bdd0-387470668318+5:2363:x1876645415827200:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 78us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708726.520624:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 113 00000100:00100000:2.0:1789708726.520813:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415826944 00000100:00100000:2.0:1789708726.520817:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415826944 00000100:00100000:2.0:1789708726.520842:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 277 00000100:00100000:2.0:1789708726.520847:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2363:x1876645415826944:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708726.520868:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2363:x1876645415826944:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 22us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708726.520872:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 277 00000100:00100000:3.0:1789708726.522342:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415827072 00000100:00100000:3.0:1789708726.522354:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415827072 00000100:00100000:3.0:1789708726.522416:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:3.0:1789708726.522426:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2363:x1876645415827072:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708726.522491:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2363:x1876645415827072:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 67us (2078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708726.522510:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00080000:3.0:1789708726.522537:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789708726.522543:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1789708726.550985:0:12434:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789708726.550995:0:12434:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789708726.551185:0:12434:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789708726.551199:0:12434:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789708726.715913:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708726.813767:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708726.814981:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415827456 00000100:00100000:0.0:1789708726.814994:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415827456 00000100:00100000:0.0:1789708726.815055:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 185 00000100:00100000:0.0:1789708726.815065:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+22:11506:x1876645415827456:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1789708726.815099:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708726.815122:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c6866d6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4ad9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.815515:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c6866d76 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.815530:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c6866d76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.815540:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c6866d76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708726.815552:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789708726.815698:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c6866d6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ad9 expref: 25 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.815716:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c6866d76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ad9 expref: 24 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.815734:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:1.0:1789708726.815737:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789708726.815740:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4200, rc 0) 00000100:00100000:1.0:1789708726.815808:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+24:11506:x1876645415827456:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 745us (2050us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1789708726.815816:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 185 00000100:00100000:3.0:1789708726.821535:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708726.821621:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415827584 00000100:00100000:1.0:1789708726.821632:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415827584 00000100:00100000:1.0:1789708726.821733:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 186 00000100:00100000:1.0:1789708726.821744:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+24:11506:x1876645415827584:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:1.0:1789708726.821847:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.821866:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.821879:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.821895:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866d8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.821902:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866d8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.821908:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866d8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.822839:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866d92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.822852:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.822861:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708726.822905:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.822919:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.822937:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d84 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.823797:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.823805:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708726.823810:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.823820:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d84 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.823835:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:1.0:1789708726.823839:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708726.823844:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.823851:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866d84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.823869:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866d8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.823875:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866d8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.823882:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866d8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.823887:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708726.823901:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866d8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.823907:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866d8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.823914:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a14033c4b00) 00010000:00010000:1.0:1789708726.823917:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708726.823921:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866d8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.823927:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866d8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.823949:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.824363:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866d92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.824371:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866d92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.824376:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708726.824379:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866d92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.824386:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866d92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.824395:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14033c4400) 00010000:00010000:1.0:1789708726.824398:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708726.824410:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866d92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.824415:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866d92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708726.824536:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+24:11506:x1876645415827584:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 2789us (3007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708726.824548:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 186 00000100:00100000:2.0:1789708726.908234:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708726.908312:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415827840 00000100:00100000:0.0:1789708726.908340:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415827840 00000100:00100000:0.0:1789708726.908408:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 187 00000100:00100000:0.0:1789708726.908420:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+24:11509:x1876645415827840:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1789708726.908444:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708726.908470:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6866d99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4ae0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.908553:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866da0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.908567:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866da0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.908579:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866da0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.908607:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866da7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.908615:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.908621:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.908947:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866dae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.908956:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.908964:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708726.908981:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789708726.909077:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866da0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.909086:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866da0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.909091:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866da0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.909097:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708726.909100:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866da0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.909107:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866da0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.909120:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:0.0:1789708726.909123:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708726.909127:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866da0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.909133:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23600/0xa8f741d1c6866da0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.909144:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.909150:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866da7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.909166:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866da7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.909171:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708726.909174:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866da7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.909179:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866da7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.909328:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a14148f3900) 00010000:00010000:0.0:1789708726.909331:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708726.909334:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866da7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.909341:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6866da7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.909387:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6866d99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ae0 expref: 27 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.909404:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866dae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ae0 expref: 26 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708726.909411:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:0.0:1789708726.909413:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708726.909415:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23c00, rc 0) 00000100:00100000:0.0:1789708726.909489:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+26:11509:x1876645415827840:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1071us (1265us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1789708726.909507:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 187 00000100:00100000:0.0:1789708726.921916:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708726.922027:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415827968 00000100:00100000:1.0:1789708726.922037:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415827968 00000100:00100000:1.0:1789708726.922107:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 188 00000100:00100000:1.0:1789708726.922118:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+26:11509:x1876645415827968:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:1.0:1789708726.922199:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866dbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.922217:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866dbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.922228:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866dbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.922257:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866dbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.922264:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866dbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.922272:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866dbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.922278:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708726.922309:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866dbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.922317:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866dbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.922338:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:1.0:1789708726.922341:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708726.922347:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866dbc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.922353:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866dbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708726.922433:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+26:11509:x1876645415827968:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 317us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708726.922441:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 188 00000100:00100000:3.0:1789708726.933365:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708726.933535:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415828224 00000100:00100000:2.0:1789708726.933545:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415828224 00000100:00100000:2.0:1789708726.933611:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:2.0:1789708726.933621:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+26:11509:x1876645415828224:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1789708726.933965:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+27:11509:x1876645415828224:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 345us (611us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1789708726.933975:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:2.0:1789708726.989975:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708726.990136:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415828480 00000100:00100000:1.0:1789708726.990148:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415828480 00000100:00100000:1.0:1789708726.990559:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 189 00000100:00100000:1.0:1789708726.990571:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+27:11043:x1876645415828480:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:1.0:1789708726.990601:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708726.990624:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866dc3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4ae7 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.990789:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866dca lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.990804:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866dae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ae0 expref: 28 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.990834:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866dca lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.990875:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866dae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ae0 expref: 28 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708726.990888:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866dae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ae0 expref: 28 pid: 5821 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708726.990902:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130a1dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1876645426297984:192.168.202.53@tcp:104: 00000100:00100000:1.0:1789708726.991009:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14051bbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708727.000135:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708727.000406:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415828608 00000100:00100000:2.0:1789708727.000420:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415828608 00010000:00010000:2.0:1789708727.000467:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866dae lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ae0 expref: 29 pid: 5821 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708727.000518:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 71 00000100:00100000:2.0:1789708727.000528:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+29:2361:x1876645415828608:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708727.000546:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708727.000572:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866dae lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ae0 expref: 29 pid: 5821 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.000586:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866dae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ae0 expref: 29 pid: 5821 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.000622:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:2.0:1789708727.000628:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866dca lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.000638:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866dca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.000645:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866dca lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.000707:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708727.000804:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+29:2361:x1876645415828608:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 276us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708727.000813:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 71 00010000:00010000:1.0:1789708727.003384:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6866dae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ae0 expref: 28 pid: 5821 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708727.003413:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130a1dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5820:1876645426297984:192.168.202.53@tcp:104: 00010000:00010000:1.0:1789708727.003438:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866dca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.003447:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866dca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.003454:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866dca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708727.003483:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789708727.003701:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866dc3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ae7 expref: 29 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.003751:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866dca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ae7 expref: 28 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.003759:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:1.0:1789708727.003762:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789708727.003766:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5400, rc 0) 00000100:00100000:1.0:1789708727.003842:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+28:11043:x1876645415828480:12345-192.168.202.53@tcp:101:bash.0 Request processed in 13273us (13893us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789708727.003851:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 189 00000100:00100000:0.0:1789708727.010269:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708727.010347:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415828864 00000100:00100000:1.0:1789708727.010358:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415828864 00000100:00100000:1.0:1789708727.010424:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 190 00000100:00100000:1.0:1789708727.010435:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+28:11043:x1876645415828864:12345-192.168.202.53@tcp:36:bash.0 00010000:00010000:1.0:1789708727.010829:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866dd8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.010848:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866dd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.010860:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866dd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789708727.010932:0:7140:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1789708727.010965:0:7140:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001234d5a8 reply state 00000000111e33c1 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866dd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708727.010974:0:7140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789708727.011031:0:7140:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1789708727.011145:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+32:11043:x1876645415828864:12345-192.168.202.53@tcp:36:bash.0 Request processed in 711us (885us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1789708727.011153:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 190 00000020:00080000:1.0:1789708727.011158:0:7140:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789708727.023111:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708727.023337:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415828992 00000100:00100000:1.0:1789708727.023350:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415828992 00000100:00100000:1.0:1789708727.023425:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 191 00000100:00100000:1.0:1789708727.023437:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+32:11043:x1876645415828992:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:1.0:1789708727.023468:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708727.023491:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866ddf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4aee expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.023567:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866ddf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4aee expref: 33 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.023581:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866ddf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4aee expref: 33 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.023606:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:1.0:1789708727.023609:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708727.023615:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4600, rc 0) 00000100:00100000:1.0:1789708727.023730:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+33:11043:x1876645415828992:12345-192.168.202.53@tcp:101:bash.0 Request processed in 285us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708727.023738:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 191 00010000:00010000:3.0:1789708727.026117:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866dd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.026140:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866dd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.026148:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866dd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.026155:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708727.026160:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866dd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.026169:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866dd8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.026203:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:3.0:1789708727.026207:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708727.026213:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866dd8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.026220:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866dd8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708727.028250:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708727.028390:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415829120 00000100:00100000:0.0:1789708727.028402:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415829120 00000100:00100000:0.0:1789708727.028476:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00100000:0.0:1789708727.028487:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+7:11043:x1876645415829120:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1789708727.028504:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708727.028527:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866de6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4af5 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708727.028553:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aacc9b5, atime: 0x6aacc9b3, ctime: 0x6aacc9b5, blocks: 0xb 00010000:00010000:0.0:1789708727.028576:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=292s v=(0 0) 00010000:00010000:0.0:1789708727.028581:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708727.028589:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866de6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4af5 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.028605:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866de6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4af5 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.028617:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23600, rc 0) 00000100:00100000:0.0:1789708727.028711:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+8:11043:x1876645415829120:12345-192.168.202.53@tcp:101:bash.0 Request processed in 225us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708727.028730:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00080000:3.0:1789708727.030784:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708727.036150:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708727.036391:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415829248 00000100:00100000:3.0:1789708727.036403:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415829248 00002000:00010000:3.0:1789708727.036462:0:6677:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789708727.036468:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1435cc5c00 with x1876645415829248 ext(0->18446744073709551615) 00002000:00010000:3.0:1789708727.036484:0:6677:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1435cc5c00. 00000100:00100000:3.0:1789708727.036526:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:3.0:1789708727.036537:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2361:x1876645415829248:12345-192.168.202.53@tcp:10:bash.0 00002000:00010000:3.0:1789708727.036926:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789708727.036931:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789708725 -> 1789708727 00002000:00010000:3.0:1789708727.036933:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789708723 -> 1789708723 00002000:00010000:3.0:1789708727.036935:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789708725 -> 1789708727 00002000:00010000:3.0:1789708727.036938:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789708727.037020:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+9:2361:x1876645415829248:12345-192.168.202.53@tcp:10:bash.0 Request processed in 483us (879us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789708727.037029:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00002000:00010000:3.0:1789708727.037034:0:6677:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789708727.037037:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1435cc5c00 with x1876645415829248 ext(0->18446744073709551615) 00002000:00010000:3.0:1789708727.037042:0:6677:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1435cc5c00. 00000100:00100000:1.0:1789708727.170744:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708727.170843:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415829376 00000100:00100000:2.0:1789708727.170853:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415829376 00000100:00100000:2.0:1789708727.170904:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 192 00000100:00100000:2.0:1789708727.170912:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+32:11523:x1876645415829376:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:2.0:1789708727.170992:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866ded lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171010:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866ded lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171037:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866ded lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171056:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866df4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171064:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171071:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171353:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866dfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171364:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866dfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171372:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866dfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789708727.171418:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866dfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171430:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866ded lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171436:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866ded lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171443:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866ded lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171459:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708727.171463:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866ded lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171470:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866ded lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171483:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:2.0:1789708727.171486:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708727.171491:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866ded lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171497:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b000/0xa8f741d1c6866ded lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171508:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171513:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866df4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171519:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866df4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171524:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708727.171527:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866df4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171534:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866df4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171548:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1414c38100) 00010000:00010000:2.0:1789708727.171549:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708727.171551:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866df4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171556:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866df4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171566:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866dfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171569:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866dfb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171573:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866dfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171576:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6ac00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708727.171578:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866dfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171581:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866dfb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171585:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:2.0:1789708727.171586:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708727.171588:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866dfb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.171591:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866dfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708727.171682:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+32:11523:x1876645415829376:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 770us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708727.171688:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 192 00000100:00100000:0.0:1789708727.268444:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708727.272844:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415829632 00000100:00100000:2.0:1789708727.272861:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415829632 00000100:00100000:3.0:1789708727.273039:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 193 00000100:00100000:3.0:1789708727.273051:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+32:11526:x1876645415829632:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1789708727.273294:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708727.273319:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866e02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4afc expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273454:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e09 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273466:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273474:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273485:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273489:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273493:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273746:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866e17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273753:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866e17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273757:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866e17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708727.273765:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789708727.273842:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273847:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e09 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273857:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273861:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708727.273864:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273870:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e09 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273878:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:3.0:1789708727.273880:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708727.273883:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273887:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273897:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273901:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273905:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273907:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708727.273909:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273918:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273923:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1411b4ad00) 00010000:00010000:3.0:1789708727.273924:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708727.273926:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273929:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273966:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866e02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4afc expref: 35 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273978:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866e17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4afc expref: 34 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.273985:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:3.0:1789708727.273987:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789708727.273989:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38200, rc 0) 00000100:00100000:3.0:1789708727.278416:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+34:11526:x1876645415829632:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 5355us (9972us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1789708727.278430:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 193 00000100:00100000:3.0:1789708727.288630:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708727.288777:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415829760 00000100:00100000:0.0:1789708727.288788:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415829760 00000100:00100000:0.0:1789708727.288854:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 194 00000100:00100000:0.0:1789708727.288865:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+34:11526:x1876645415829760:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:0.0:1789708727.288940:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866e25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.288975:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866dca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ae7 expref: 34 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.288986:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866e25 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.289159:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866dca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ae7 expref: 34 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.289174:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866dca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ae7 expref: 34 pid: 5820 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708727.289201:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a140366ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1876645426298112:192.168.202.53@tcp:104: 00000100:00100000:0.0:1789708727.289400:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140319fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708727.294627:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708727.294760:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a140366ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1876645426298112:192.168.202.53@tcp:104: 00010000:00010000:1.0:1789708727.294799:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866e25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708727.294917:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415830016 00000100:00100000:2.0:1789708727.294927:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415830016 00000100:00100000:2.0:1789708727.295499:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:2.0:1789708727.295511:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+35:5591:x1876645415830016:12345-192.168.202.53@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789708727.296074:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+36:5591:x1876645415830016:12345-192.168.202.53@tcp:35:ldlm_bl.0 Request processed in 563us (1455us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789708727.296084:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:1.0:1789708727.299811:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708727.299913:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415830144 00000100:00100000:0.0:1789708727.299924:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415830144 00010000:00010000:0.0:1789708727.299988:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866dca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ae7 expref: 36 pid: 5820 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708727.300033:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 72 00000100:00100000:0.0:1789708727.300059:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+36:2362:x1876645415830144:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708727.300076:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708727.300084:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866dca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ae7 expref: 36 pid: 5820 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.300100:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866dca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ae7 expref: 36 pid: 5820 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.300126:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6866dca lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ae7 expref: 36 pid: 5820 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.300145:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:0.0:1789708727.300150:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866e25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.300159:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866e25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.300167:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866e25 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.300210:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708727.300761:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866e25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.300770:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866e25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.300804:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866e25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.300811:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866e25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.300818:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866e25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.300823:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708727.300828:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866e25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.300836:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866e25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.300845:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:1.0:1789708727.300848:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708727.300852:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866e25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.300857:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c6866e25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708727.300928:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+35:11526:x1876645415829760:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 12064us (12309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708727.300937:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 194 00000100:00100000:0.0:1789708727.301430:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+35:2362:x1876645415830144:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 221us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708727.301442:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 72 00000100:00100000:1.0:1789708727.310275:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708727.310392:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415830400 00000100:00100000:0.0:1789708727.310406:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415830400 00000100:00100000:0.0:1789708727.310473:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:0.0:1789708727.310485:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+34:11526:x1876645415830400:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:0.0:1789708727.310830:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+35:11526:x1876645415830400:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 346us (568us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789708727.310838:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:2.0:1789708727.406797:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708727.406934:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415830656 00000100:00100000:1.0:1789708727.406945:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415830656 00000100:00100000:1.0:1789708727.407388:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 195 00000100:00100000:1.0:1789708727.407399:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+35:11536:x1876645415830656:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:1.0:1789708727.407426:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708727.407446:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6866e2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b03 expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.407515:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e33 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.407529:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.407540:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.407556:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c6866e3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.407564:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c6866e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.407570:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c6866e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.407924:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5e00/0xa8f741d1c6866e41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.407934:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5e00/0xa8f741d1c6866e41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.407941:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5e00/0xa8f741d1c6866e41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708727.407969:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789708727.408112:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.408121:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e33 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.408128:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.408133:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708727.408138:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.408145:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e33 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.408168:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:1.0:1789708727.408171:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708727.408176:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.408321:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.408337:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c6866e3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.408343:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c6866e3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.408349:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c6866e3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.408354:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4a00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708727.408357:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c6866e3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.408364:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c6866e3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.408373:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a14033c4400) 00010000:00010000:1.0:1789708727.408376:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708727.408379:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c6866e3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.408385:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c6866e3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.408436:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6866e2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b03 expref: 38 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.408449:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5e00/0xa8f741d1c6866e41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b03 expref: 37 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.408463:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:1.0:1789708727.408466:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708727.408468:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5e00, rc 0) 00000100:00100000:1.0:1789708727.408615:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+37:11536:x1876645415830656:12345-192.168.202.53@tcp:101:cat.0 Request processed in 1217us (1826us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789708727.408623:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 195 00000100:00100000:1.0:1789708727.421811:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708727.421918:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415830912 00000100:00100000:0.0:1789708727.421931:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415830912 00000100:00100000:0.0:1789708727.421992:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:0.0:1789708727.422003:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+37:11536:x1876645415830912:12345-192.168.202.53@tcp:35:cat.0 00000100:00100000:0.0:1789708727.422681:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+38:11536:x1876645415830912:12345-192.168.202.53@tcp:35:cat.0 Request processed in 645us (847us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789708727.422690:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:0.0:1789708727.442987:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708727.443052:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415831168 00000100:00100000:3.0:1789708727.443067:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415831168 00000100:00100000:3.0:1789708727.443370:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 196 00000100:00100000:3.0:1789708727.443383:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+38:11538:x1876645415831168:12345-192.168.202.53@tcp:36:rm.0 00010000:00010000:3.0:1789708727.443478:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789708727.443513:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5e00/0xa8f741d1c6866e41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b03 expref: 38 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.443535:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866e17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4afc expref: 37 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.443549:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6866ddf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4aee expref: 36 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.443558:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a14148f3f00) 00010000:00010000:3.0:1789708727.443571:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708727.443594:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866e4f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.443612:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866e4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.443622:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866e4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.443639:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e56 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.443698:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.443708:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444017:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444027:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444033:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708727.444611:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1789708727.444622:0:5819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 293241971622ns, next at 294241968277ns, rc = 0 00010000:00010000:3.0:1789708727.444727:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866e64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444739:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866e64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444747:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866e64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444754:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866e64 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444760:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866e64 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444767:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866e64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444787:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708727.444811:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444824:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e5d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444831:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e5d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444837:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708727.444841:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e5d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444850:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e5d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444863:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1411b4a100) 00010000:00010000:3.0:1789708727.444866:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789708727.444871:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e5d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444876:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866e5d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444894:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866e4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444901:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866e4f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444906:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866e4f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444909:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708727.444918:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866e4f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444925:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866e4f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444933:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:3.0:1789708727.444936:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708727.444939:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866e4f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.444945:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866e4f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708727.444955:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058bb4b23 reply state 00000000ecbadb7b transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708727.444964:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789708727.445056:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+37:11538:x1876645415831168:12345-192.168.202.53@tcp:36:rm.0 Request processed in 1674us (2075us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789708727.445066:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 196 00010000:00010000:0.0:1789708727.445163:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708727.445170:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866e64 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.445177:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38600 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708727.445188:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866e64 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.445194:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866e64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.445205:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a1411b4a100) 00010000:00010000:0.0:1789708727.445207:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789708727.445210:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866e64 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.445217:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866e64 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.445240:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708727.445242:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708727.445244:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708727.451306:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.451385:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e56 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.451396:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.451403:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708727.451408:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.451418:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e56 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.451434:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1411b4ad00) 00010000:00010000:0.0:1789708727.451438:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708727.451443:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e56 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.451449:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866e56 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708727.498361:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708727.498418:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415831424 00000100:00100000:1.0:1789708727.498429:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415831424 00000100:00100000:1.0:1789708727.498489:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 197 00000100:00100000:1.0:1789708727.498500:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14037b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+36:11544:x1876645415831424:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:1.0:1789708727.498525:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708727.498548:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c6866e6b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b0a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.498691:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e72 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.498708:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.498788:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.498806:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866e79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.498814:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866e79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.498838:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866e79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789708727.503705:0:5821:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789708727.504778:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866e80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.504799:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866e80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.504812:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866e80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.504852:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.504860:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e72 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.504868:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.504874:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708727.504878:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.504886:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e72 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.504899:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:1.0:1789708727.504902:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708727.504921:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e72 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.504928:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c6866e72 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708727.504944:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2b9e9d0 reply state 00000000973c9592 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866e79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708727.504951:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789708727.504989:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c6866e6b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b0a expref: 39 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.505004:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866e80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b0a expref: 38 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.505013:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a14033c4b00) 00010000:00010000:1.0:1789708727.505015:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708727.505018:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5000, rc 0) 00000100:00100000:1.0:1789708727.505108:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14037b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+39:11544:x1876645415831424:12345-192.168.202.53@tcp:101:bash.0 Request processed in 6609us (6757us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1789708727.505118:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 197 00000100:00100000:2.0:1789708727.511001:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00010000:00010000:3.0:1789708727.511115:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866e79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.511128:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866e79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.511138:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866e79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.511154:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5a00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708727.511159:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866e79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.511188:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866e79 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.511204:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a14033c4400) 00010000:00010000:3.0:1789708727.511207:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708727.511212:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866e79 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.511218:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866e79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708727.512737:0:11993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415831552 00000100:00100000:1.0:1789708727.512751:0:11993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415831552 00000100:00100000:1.0:1789708727.512813:0:11993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:1.0:1789708727.512823:0:11993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2362:x1876645415831552:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:1.0:1789708727.512842:0:11993:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708727.512863:0:11993:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c6866e8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b11 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789708727.512908:0:11993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708727.512931:0:11993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=293s v=(0 0) 00010000:00010000:1.0:1789708727.512936:0:11993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708727.512944:0:11993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c6866e8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b11 expref: 6 pid: 11993 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.512963:0:11993:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c6866e8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b11 expref: 6 pid: 11993 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.512976:0:11993:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4000, rc 0) 00000100:00100000:1.0:1789708727.513046:0:11993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2362:x1876645415831552:12345-192.168.202.53@tcp:101:bash.0 Request processed in 225us (2057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708727.513054:0:11993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:2.0:1789708727.519930:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708727.520057:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415831680 00000100:00100000:0.0:1789708727.520067:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415831680 00000100:00100000:0.0:1789708727.520595:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:0.0:1789708727.520604:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+6:11544:x1876645415831680:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1789708727.520625:0:10424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708727.520645:0:10424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000988150dc/0xa8f741d1c6866e95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b18 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.520700:0:10424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c6866e8e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b11 expref: 7 pid: 11993 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.520710:0:10424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708727.520723:0:10424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708727.520730:0:10424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000988150dc/0xa8f741d1c6866e95 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b18 expref: 7 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.520770:0:10424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c6866e8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b11 expref: 7 pid: 11993 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.520784:0:10424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c6866e8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b11 expref: 7 pid: 11993 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708727.520799:0:10424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f285c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10424:1876645426298240:192.168.202.53@tcp:104: 00000100:00100000:0.0:1789708727.520983:0:10424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140319f480 going to sleep for 11 seconds 00000100:00100000:1.0:1789708727.537120:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708727.537316:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415831808 00000100:00100000:3.0:1789708727.537327:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415831808 00010000:00010000:3.0:1789708727.537364:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c6866e8e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b11 expref: 8 pid: 11993 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708727.537409:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 73 00000100:00100000:3.0:1789708727.537419:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2361:x1876645415831808:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708727.537436:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708727.537460:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c6866e8e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b11 expref: 8 pid: 11993 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.537474:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c6866e8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b11 expref: 8 pid: 11993 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.537503:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708727.537520:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708727.537547:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000988150dc/0xa8f741d1c6866e95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b18 expref: 8 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.537559:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000988150dc/0xa8f741d1c6866e95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b18 expref: 8 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.537604:0:5804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000988150dc/0xa8f741d1c6866e95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b18 expref: 8 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708727.537619:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130a5aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5804:1876645426298368:192.168.202.53@tcp:105: 00000100:00100000:3.0:1789708727.537743:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1407e23a80 going to sleep for 11 seconds 00010000:00010000:2.0:1789708727.538479:0:10424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c6866e8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b11 expref: 8 pid: 11993 timeout: 393 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708727.538498:0:10424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f285c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10424:1876645426298240:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708727.538522:0:10424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000988150dc/0xa8f741d1c6866e95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b18 expref: 7 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.538535:0:10424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d22a00, rc 0) 00000100:00100000:2.0:1789708727.538589:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+7:11544:x1876645415831680:12345-192.168.202.53@tcp:101:bash.0 Request processed in 17985us (18666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708727.538612:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:3.0:1789708727.543509:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130a5aed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5804:1876645426298368:192.168.202.53@tcp:105: 00010000:00010000:3.0:1789708727.543553:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708727.543617:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415831808:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 6198us (6507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708727.543629:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 73 00000100:00100000:0.0:1789708727.547901:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708727.548198:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415832064 00000100:00100000:2.0:1789708727.548210:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415832064 00000100:00100000:2.0:1789708727.548267:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:2.0:1789708727.548288:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+38:11544:x1876645415832064:12345-192.168.202.53@tcp:35:bash.0 00000100:00100000:2.0:1789708727.548642:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+39:11544:x1876645415832064:12345-192.168.202.53@tcp:35:bash.0 Request processed in 365us (750us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789708727.548674:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:0.0:1789708727.550053:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130a5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426298496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708727.550121:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708727.551208:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426298496 00000100:00100000:3.0:1789708727.551219:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426298496 00000100:00100000:3.0:1789708727.551297:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789708727.551306:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1876645426298496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789708727.551345:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708727.551414:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1876645426298496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708727.551422:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789708727.551738:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130a5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426298496:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789708727.551825:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789708727.741487:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708727.774133:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708727.774268:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415832192 00000100:00100000:3.0:1789708727.774278:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415832192 00000100:00100000:3.0:1789708727.774365:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 198 00000100:00100000:3.0:1789708727.774376:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+39:11560:x1876645415832192:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1789708727.774403:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708727.774425:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866e9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b1f expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.774511:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866ea3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.774526:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.774536:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708727.774570:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789708727.774574:0:7140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789708727.774589:0:7140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.774613:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866e9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b1f expref: 41 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.774631:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b1f expref: 40 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.774639:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:3.0:1789708727.774641:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789708727.774644:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38c00, rc 0) 00000100:00100000:3.0:1789708727.774766:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+40:11560:x1876645415832192:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 392us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708727.774779:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 198 00000100:00100000:1.0:1789708727.780422:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708727.780747:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415832448 00000100:00100000:3.0:1789708727.780761:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415832448 00000100:00100000:3.0:1789708727.780832:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 199 00000100:00100000:3.0:1789708727.780842:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+40:11560:x1876645415832448:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1789708727.780863:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708727.780885:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866eaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b26 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.781021:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866eb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.781036:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.781048:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708727.781061:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789708727.781417:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866eaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b26 expref: 43 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.781440:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b26 expref: 42 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.781448:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a14033c4b00) 00010000:00010000:3.0:1789708727.781451:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708727.781455:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38200, rc 0) 00000100:00100000:3.0:1789708727.781806:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+42:11560:x1876645415832448:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 964us (1392us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789708727.781815:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 199 00000100:00100000:1.0:1789708727.789984:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708727.790045:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708727.790171:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415832704 00000100:00100000:0.0:1789708727.790192:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415832704 00000100:00100000:0.0:1789708727.790257:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 200 00000100:00100000:0.0:1789708727.790268:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+42:11560:x1876645415832704:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1789708727.790294:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708727.790317:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c6866ebf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b2d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.790416:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866ec6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.790432:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.790443:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708727.790456:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789708727.790585:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c6866ebf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b2d expref: 45 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.790605:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866ec6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b2d expref: 44 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.790614:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a14033c4b00) 00010000:00010000:0.0:1789708727.790617:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789708727.790621:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d22e00, rc 0) 00000100:00100000:0.0:1789708727.790740:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+44:11560:x1876645415832704:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 474us (768us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789708727.790763:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 200 00000100:00100000:2.0:1789708727.791911:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415832832 00000100:00100000:2.0:1789708727.791923:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415832832 00000100:00100000:2.0:1789708727.792009:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:2.0:1789708727.792019:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+44:2363:x1876645415832832:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708727.792034:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708727.792058:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866eb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b26 expref: 44 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.792077:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a14033c4b00) 00010000:00010000:2.0:1789708727.792082:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708727.792149:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+43:2363:x1876645415832832:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 132us (2103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708727.792157:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:1.0:1789708727.800483:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708727.800567:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415832960 00000100:00100000:2.0:1789708727.800578:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415832960 00000100:00100000:2.0:1789708727.800638:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:2.0:1789708727.800647:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+6:2361:x1876645415832960:12345-192.168.202.53@tcp:1:lfs.0 00010000:00010000:2.0:1789708727.800749:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c6866ed4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.800769:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000988150dc/0xa8f741d1c6866e95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b18 expref: 6 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.800778:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708727.800782:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789708727.800786:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c6866ed4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.800827:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000988150dc/0xa8f741d1c6866e95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b18 expref: 6 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.800841:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000988150dc/0xa8f741d1c6866e95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b18 expref: 6 pid: 10424 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708727.800856:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1426d08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6673:1876645426298624:192.168.202.53@tcp:104: 00000100:00100000:2.0:1789708727.801755:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14089c7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789708727.804578:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1426d08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6673:1876645426298624:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708727.804617:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c6866ed4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708727.806528:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708727.806863:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415833088 00000100:00100000:0.0:1789708727.806873:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415833088 00002000:00100000:0.0:1789708727.806928:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8a130a1df800 x1876645415833088/t0(0) o4->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:113/0 lens 504/0 e 0 to 0 dl 1789708738 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789708727.806939:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a130a1df800 with x1876645415833088 ext(0->8) 00010000:00010000:0.0:1789708727.806958:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000988150dc/0xa8f741d1c6866e95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b18 expref: 7 pid: 10424 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.806976:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000988150dc/0xa8f741d1c6866e95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b18 expref: 7 pid: 10424 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708727.806984:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a130a1df800 00000100:00100000:0.0:1789708727.807162:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:0.0:1789708727.807270:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2361:x1876645415833088:12345-192.168.202.53@tcp:4:lfs.0 00000100:00100000:0.0:1789708727.807822:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+9:2361:x1876645415833088:12345-192.168.202.53@tcp:4:lfs.0 Request processed in 648us (1301us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789708727.807831:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 3 00002000:00100000:0.0:1789708727.807840:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8a130a1df800 x1876645415833088/t4294967308(0) o4->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:113/0 lens 504/448 e 0 to 0 dl 1789708738 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789708727.807849:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a130a1df800 with x1876645415833088 ext(0->8) 00010000:00010000:0.0:1789708727.807857:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000988150dc/0xa8f741d1c6866e95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b18 expref: 9 pid: 10424 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.807881:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000988150dc/0xa8f741d1c6866e95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b18 expref: 9 pid: 10424 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708727.807889:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a130a1df800 00000100:00100000:1.0:1789708727.810710:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708727.810828:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415833216 00000100:00100000:0.0:1789708727.810840:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415833216 00010000:00010000:0.0:1789708727.810895:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000988150dc/0xa8f741d1c6866e95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b18 expref: 9 pid: 10424 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708727.810940:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 74 00000100:00100000:0.0:1789708727.810960:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1407f55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+9:2362:x1876645415833216:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708727.810979:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789708727.811000:0:5806:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789708727.811011:0:5806:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789708727 00002000:00010000:0.0:1789708727.811014:0:5806:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789708728 00002000:00010000:0.0:1789708727.811016:0:5806:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789708727 00010000:00010000:0.0:1789708727.811021:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000988150dc/0xa8f741d1c6866e95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b18 expref: 9 pid: 10424 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.811035:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000988150dc/0xa8f741d1c6866e95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b18 expref: 9 pid: 10424 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.811060:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000988150dc/0xa8f741d1c6866e95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b18 expref: 9 pid: 10424 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.811101:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789708727.811106:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789708727.811112:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c6866ed4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.811123:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c6866ed4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.811163:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708727.811232:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1407f55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2362:x1876645415833216:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 282us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708727.811239:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 74 00010000:00010000:2.0:1789708727.812296:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c6866ed4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.812329:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c6866ed4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.812361:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c6866ed4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.812369:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c6866ed4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.812377:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c6866ed4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.812384:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6bc00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:2.0:1789708727.812389:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c6866ed4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.812400:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c6866ed4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.812418:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c6866ed4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.812429:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066760fd7/0xa8f741d1c6866ed4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708727.812540:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2361:x1876645415832960:12345-192.168.202.53@tcp:1:lfs.0 Request processed in 11891us (12064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708727.812551:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:1.0:1789708727.817254:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708727.817374:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415833472 00000100:00100000:2.0:1789708727.817385:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415833472 00000100:00100000:2.0:1789708727.817449:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:2.0:1789708727.817460:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14069fb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+43:11560:x1876645415833472:12345-192.168.202.53@tcp:35:lfs.0 00000004:00010000:2.0:1789708727.817531:0:5822:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866ec6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b2d expref: 43 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789708727.817862:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1789708727.817904:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1789708727.818446:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1789708727.818497:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866edb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.818514:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866e80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b0a expref: 47 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.818523:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866edb lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.818564:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866e80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b0a expref: 47 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.818581:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866e80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b0a expref: 47 pid: 5821 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708727.818615:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1426d08700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5822:1876645426298752:192.168.202.53@tcp:104: 00000100:00100000:2.0:1789708727.818756:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14089c7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708727.825985:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708727.826230:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415833600 00000100:00100000:0.0:1789708727.826241:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415833600 00010000:00010000:0.0:1789708727.826282:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866e80 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b0a expref: 48 pid: 5821 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708727.826325:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 75 00000100:00100000:0.0:1789708727.826335:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+48:2361:x1876645415833600:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708727.826352:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708727.826360:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866e80 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b0a expref: 48 pid: 5821 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.826377:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866e80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b0a expref: 48 pid: 5821 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.826422:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a14033c4b00) 00010000:00010000:0.0:1789708727.826427:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866edb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.826436:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866edb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.826443:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866edb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708727.826467:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708727.826534:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+48:2361:x1876645415833600:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 200us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708727.826542:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 75 00010000:00010000:2.0:1789708727.827995:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866e80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b0a expref: 47 pid: 5821 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708727.828030:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1426d08700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5822:1876645426298752:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708727.828058:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866edb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.828071:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866edb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.828077:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866edb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789708727.828531:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1789708727.828887:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1789708727.829049:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1426d08700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1876645426298880:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789708727.829143:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708727.829255:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14089c73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708727.829848:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426298880 00000100:00100000:1.0:1789708727.829858:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426298880 00000100:00100000:1.0:1789708727.829921:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789708727.829931:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5822:x1876645426298880:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789708727.830039:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5822:x1876645426298880:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 109us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708727.830047:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789708727.830155:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1426d08700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1876645426298880:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789708727.830630:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1789708727.830736:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130a5ac000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1876645426299008:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789708727.830778:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708727.830809:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1407e230c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708727.831590:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426299008 00000100:00100000:1.0:1789708727.831600:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426299008 00000100:00100000:1.0:1789708727.831641:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789708727.831685:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5822:x1876645426299008:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789708727.831906:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5822:x1876645426299008:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 256us (1126us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789708727.831913:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789708727.832361:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130a5ac000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5822:1876645426299008:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789708727.832436:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1789708727.832482:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866edb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.832492:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866edb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.832498:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866edb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.832504:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6be00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708727.832508:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866edb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.832515:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866edb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.832530:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a14033c4b00) 00010000:00010000:3.0:1789708727.832534:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789708727.832538:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866edb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.832556:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6866edb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789708727.832808:0:5822:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789708727.832911:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1789708727.832923:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 293630272012ns, next at 294630269382ns, rc = 0 00000001:00080000:3.0:1789708727.832929:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1789708727.832973:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a14033c4b00) 00010000:00010000:3.0:1789708727.832976:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789708727.832986:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c6866ec6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b2d expref: 51 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708727.833523:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14069fb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+50:11560:x1876645415833472:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 16062us (16279us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1789708727.833534:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 56 00000020:00080000:3.0:1789708727.833540:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789708727.836454:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708727.836547:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415833728 00000100:00100000:2.0:1789708727.836558:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415833728 00000100:00100000:2.0:1789708727.836695:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 201 00000100:00100000:2.0:1789708727.836706:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+50:11560:x1876645415833728:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708727.836741:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708727.836766:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866ee2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b34 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.836847:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b34 expref: 51 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.836860:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b34 expref: 51 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708727.836880:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:2.0:1789708727.836884:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789708727.836887:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6bc00, rc 0) 00000100:00100000:2.0:1789708727.836959:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+51:11560:x1876645415833728:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 254us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708727.836967:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 201 00000100:00100000:1.0:1789708727.840785:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708727.840873:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415833984 00000100:00100000:0.0:1789708727.840886:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415833984 00000100:00100000:0.0:1789708727.840948:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:0.0:1789708727.840958:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+51:11560:x1876645415833984:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:0.0:1789708727.841248:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+52:11560:x1876645415833984:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 291us (472us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1789708727.841257:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:3.0:1789708727.941994:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708727.942132:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415834112 00000100:00100000:1.0:1789708727.942146:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415834112 00000100:00100000:1.0:1789708727.942228:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 202 00000100:00100000:1.0:1789708727.942239:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+52:11570:x1876645415834112:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:1.0:1789708727.942334:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ee9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942353:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942365:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942382:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866ef0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942407:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942414:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942517:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866ef7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942525:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942531:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708727.942576:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942593:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942600:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ee9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942606:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ee9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942613:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708727.942616:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ee9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942623:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ee9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942641:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:1.0:1789708727.942645:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708727.942705:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ee9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942747:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c6866ee9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942761:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942767:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866ef0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942773:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942779:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708727.942782:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942788:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942795:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a14033c4b00) 00010000:00010000:1.0:1789708727.942798:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708727.942801:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866ef0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942806:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4400/0xa8f741d1c6866ef0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942830:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942836:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866ef7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942841:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942846:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708727.942849:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942855:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942862:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:1.0:1789708727.942864:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708727.942867:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866ef7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.942873:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866ef7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708727.942979:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+52:11570:x1876645415834112:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 741us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708727.942987:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 202 00000100:00100000:1.0:1789708727.982305:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708727.982449:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415834368 00000100:00100000:3.0:1789708727.982460:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415834368 00000100:00100000:3.0:1789708727.982520:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 203 00000100:00100000:3.0:1789708727.982530:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+52:11573:x1876645415834368:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1789708727.982555:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708727.982576:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866efe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b3b expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.982694:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.982739:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.982752:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.982770:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.982778:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.982785:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.982904:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866f13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.982913:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.982921:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708727.982931:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789708727.983054:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.983063:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.983068:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.983081:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708727.983632:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.983643:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.983681:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:3.0:1789708727.983684:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708727.983689:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.983695:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.983709:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.983725:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.983731:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.983736:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708727.983740:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.983746:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.983765:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1411b4aa00) 00010000:00010000:3.0:1789708727.983768:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708727.983772:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.983777:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.983835:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866efe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b3b expref: 55 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.983851:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866f13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b3b expref: 54 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708727.983859:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:3.0:1789708727.983862:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708727.983864:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39c00, rc 0) 00000100:00100000:3.0:1789708727.983962:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+54:11573:x1876645415834368:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1433us (1674us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789708727.983971:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 203 00000100:00100000:2.0:1789708727.994635:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708727.994768:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415834496 00000100:00100000:1.0:1789708727.994780:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415834496 00000100:00100000:1.0:1789708727.994862:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 204 00000100:00100000:1.0:1789708727.994871:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+54:11573:x1876645415834496:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:1.0:1789708727.994950:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866f21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.994968:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866f21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.994979:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866f21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.995016:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866f21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.995025:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866f21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.995031:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866f21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.995038:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708727.995042:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866f21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.995049:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866f21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.995061:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:1.0:1789708727.995065:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708727.995069:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866f21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708727.995086:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c6866f21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708727.995168:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+54:11573:x1876645415834496:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 297us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708727.995177:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 204 00000100:00100000:0.0:1789708727.998057:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708727.998151:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415834752 00000100:00100000:2.0:1789708727.998161:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415834752 00000100:00100000:2.0:1789708727.998220:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00100000:2.0:1789708727.998228:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+54:11573:x1876645415834752:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1789708727.998472:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+55:11573:x1876645415834752:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 244us (424us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1789708727.998481:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00100000:2.0:1789708728.059899:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130a1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426299136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708728.060013:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708728.060373:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426299136 00000100:00100000:3.0:1789708728.060382:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426299136 00000100:00100000:3.0:1789708728.060459:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789708728.060469:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1876645426299136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789708728.060511:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708728.060565:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1876645426299136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708728.060591:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789708728.060647:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130a1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426299136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708728.062129:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130a1ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426299520:0@lo:400:kworker.0 00000100:00100000:0.0:1789708728.062215:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708728.062267:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708728.062274:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130a1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876645426299648:0@lo:400:kworker.0 00000100:00100000:0.0:1789708728.062320:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708728.063034:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426299520 00000100:00100000:1.0:1789708728.063046:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426299520 00000100:00100000:1.0:1789708728.063125:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426299648 00000100:00100000:1.0:1789708728.063128:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426299648 00000100:00100000:1.0:1789708728.063154:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789708728.063162:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426299520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708728.063250:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426299520:12345-0@lo:400:kworker.0 Request processed in 88us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708728.063259:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789708728.063278:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789708728.063285:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876645426299648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708728.063312:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876645426299648:12345-0@lo:400:kworker.0 Request processed in 28us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708728.063317:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789708728.063729:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130a1dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426299264:0@lo:400:kworker.0 00000100:00100000:3.0:1789708728.063772:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708728.063816:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789708728.063823:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130a1dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426299392:0@lo:400:kworker.0 00000100:00100000:3.0:1789708728.063846:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708728.063882:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426299392 00000100:00100000:3.0:1789708728.063886:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426299392 00000100:00100000:3.0:1789708728.063916:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789708728.063922:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426299392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708728.063970:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426299392:12345-0@lo:400:kworker.0 Request processed in 47us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708728.063976:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789708728.064018:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130a1dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426299392:0@lo:400:kworker.0 00000100:00100000:0.0:1789708728.065581:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130a1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876645426299648:0@lo:400:kworker.0 00000100:00100000:0.0:1789708728.065597:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130a1ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426299520:0@lo:400:kworker.0 00000100:00080000:2.0:1789708728.065731:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789708728.065738:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708728.065885:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426299264 00000100:00100000:1.0:1789708728.065893:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426299264 00000100:00100000:1.0:1789708728.065959:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789708728.065969:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3286:x1876645426299264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708728.066063:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3286:x1876645426299264:12345-0@lo:400:kworker.0 Request processed in 94us (2290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708728.066086:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789708728.066421:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130a1dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426299264:0@lo:400:kworker.0 00000100:00100000:0.0:1789708728.113645:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708728.113773:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415835008 00000100:00100000:3.0:1789708728.113783:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415835008 00000100:00100000:3.0:1789708728.113866:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 205 00000100:00100000:3.0:1789708728.113875:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+55:11583:x1876645415835008:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:3.0:1789708728.113902:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708728.113905:0:7140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789708728.113935:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866ea3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b1f expref: 55 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.113974:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:3.0:1789708728.113980:0:7140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708728.113996:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866f28 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b42 expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.114112:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.114126:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.114137:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708728.114149:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789708728.114282:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866f28 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b42 expref: 57 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.114296:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b42 expref: 56 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.114303:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:3.0:1789708728.114306:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708728.114309:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38200, rc 0) 00000100:00100000:3.0:1789708728.114378:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+56:11583:x1876645415835008:12345-192.168.202.53@tcp:101:bash.0 Request processed in 504us (741us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1789708728.114385:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 205 00000100:00080000:2.0:1789708728.114681:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708728.120102:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708728.120200:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415835264 00000100:00100000:3.0:1789708728.120212:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415835264 00000100:00100000:3.0:1789708728.120326:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 206 00000100:00100000:3.0:1789708728.120338:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+56:11583:x1876645415835264:12345-192.168.202.53@tcp:36:bash.0 00010000:00010000:3.0:1789708728.120397:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789708728.120428:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b42 expref: 56 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.120450:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866f13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b3b expref: 55 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.120460:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:3.0:1789708728.120465:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708728.120701:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.120725:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.120736:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789708728.120786:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1789708728.120810:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000323f32ba reply state 000000009f9a8e4f transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708728.120819:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789708728.120908:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+57:11583:x1876645415835264:12345-192.168.202.53@tcp:36:bash.0 Request processed in 572us (816us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1789708728.120917:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 206 00000020:00080000:3.0:1789708728.120935:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789708728.123604:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.123619:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.123627:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.123633:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708728.123637:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.123646:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.123693:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:1.0:1789708728.123697:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708728.123702:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.123718:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c6866f3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708728.132878:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708728.134192:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415835392 00000100:00100000:0.0:1789708728.134205:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415835392 00000100:00100000:0.0:1789708728.134271:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 207 00000100:00100000:0.0:1789708728.134280:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+56:11583:x1876645415835392:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1789708728.134303:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708728.134322:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866f44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b49 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.134402:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866f4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.134415:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.134426:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708728.134454:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789708728.134458:0:11601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789708728.134474:0:11601:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.134498:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866f44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b49 expref: 58 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.134534:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866f4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b49 expref: 57 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.134543:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:0.0:1789708728.134546:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708728.134549:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d22800, rc 0) 00000100:00100000:0.0:1789708728.134816:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+57:11583:x1876645415835392:12345-192.168.202.53@tcp:101:bash.0 Request processed in 536us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708728.134824:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 207 00000100:00100000:0.0:1789708728.139828:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708728.143529:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415835648 00000100:00100000:2.0:1789708728.143544:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415835648 00000100:00100000:2.0:1789708728.143619:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:2.0:1789708728.143630:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+57:11583:x1876645415835648:12345-192.168.202.53@tcp:35:bash.0 00000100:00100000:2.0:1789708728.143907:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+58:11583:x1876645415835648:12345-192.168.202.53@tcp:35:bash.0 Request processed in 278us (4089us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789708728.143916:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:1.0:1789708728.212438:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708728.212536:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415835776 00000100:00100000:3.0:1789708728.212551:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415835776 00000100:00100000:3.0:1789708728.212615:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 208 00000100:00100000:3.0:1789708728.212626:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+58:11589:x1876645415835776:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1789708728.212683:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708728.212707:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866f52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b50 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.212788:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.212802:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.212813:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708728.212852:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789708728.212856:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789708728.212872:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.212896:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866f52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b50 expref: 60 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.212915:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b50 expref: 59 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.212923:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:3.0:1789708728.212940:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789708728.212943:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38200, rc 0) 00000100:00100000:3.0:1789708728.213013:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+59:11589:x1876645415835776:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 376us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708728.213020:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 208 00000100:00100000:1.0:1789708728.221870:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708728.221943:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415835904 00000100:00100000:3.0:1789708728.221954:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415835904 00000100:00100000:3.0:1789708728.222030:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 209 00000100:00100000:3.0:1789708728.222042:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+59:11589:x1876645415835904:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1789708728.222064:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708728.222086:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866f60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b57 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222154:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866f67 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222180:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866f67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222191:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866f67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222211:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222218:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222225:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222335:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866f75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222345:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222351:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708728.222388:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789708728.222393:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789708728.222690:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222704:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222725:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866f67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222732:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866f67 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222738:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866f67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222745:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708728.222749:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866f67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222758:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866f67 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222783:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:3.0:1789708728.222786:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708728.222792:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866f67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222799:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866f67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222812:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222818:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222824:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222829:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708728.222832:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222839:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222847:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a1411b4aa00) 00010000:00010000:3.0:1789708728.222849:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708728.222852:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222858:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222899:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866f60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b57 expref: 61 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222913:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866f75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b57 expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.222921:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:3.0:1789708728.222923:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789708728.222926:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38600, rc 0) 00000100:00100000:3.0:1789708728.223004:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+60:11589:x1876645415835904:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 957us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708728.223013:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 209 00000100:00100000:1.0:1789708728.228408:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708728.228481:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708728.228587:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415836032 00000100:00100000:0.0:1789708728.228598:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415836032 00000100:00100000:0.0:1789708728.228718:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:0.0:1789708728.228729:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+60:2361:x1876645415836032:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708728.228745:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708728.228775:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866f75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b57 expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.228794:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:0.0:1789708728.228799:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708728.228856:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+59:2361:x1876645415836032:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 129us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708728.228864:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:2.0:1789708728.228931:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415836288 00000100:00100000:2.0:1789708728.228936:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415836288 00000100:00100000:2.0:1789708728.228991:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 210 00000100:00100000:2.0:1789708728.229006:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+59:11589:x1876645415836288:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708728.229022:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708728.229037:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866f7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b5e expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.229154:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866f83 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.229168:0:11601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866f4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b49 expref: 60 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.229189:0:11601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866f83 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.229230:0:11601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866f4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b49 expref: 60 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.229242:0:11601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866f4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b49 expref: 60 pid: 11601 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708728.229265:0:11601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1426d0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11601:1876645426299776:192.168.202.53@tcp:104: 00000100:00100000:2.0:1789708728.229346:0:11601:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14089c7240 going to sleep for 11 seconds 00000100:00100000:1.0:1789708728.235233:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708728.235322:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415836416 00000100:00100000:0.0:1789708728.235335:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415836416 00010000:00010000:0.0:1789708728.235410:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866f4b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b49 expref: 61 pid: 11601 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708728.235460:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 76 00000100:00100000:0.0:1789708728.235470:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+61:2362:x1876645415836416:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708728.235490:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708728.235498:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866f4b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b49 expref: 61 pid: 11601 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.235512:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866f4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b49 expref: 61 pid: 11601 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.235535:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:0.0:1789708728.235541:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866f83 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.235551:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866f83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.235559:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866f83 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.235578:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708728.235635:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+61:2362:x1876645415836416:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 166us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708728.235642:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 76 00010000:00010000:2.0:1789708728.237737:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22800/0xa8f741d1c6866f4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b49 expref: 60 pid: 11601 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708728.237769:0:11601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1426d0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11601:1876645426299776:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708728.237800:0:11601:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866f83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.237812:0:11601:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866f83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.237818:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866f83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708728.237846:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789708728.238066:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866f7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b5e expref: 61 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.238082:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866f83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b5e expref: 60 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.238091:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:2.0:1789708728.238094:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789708728.238098:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6ac00, rc 0) 00000100:00100000:2.0:1789708728.238159:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+60:11589:x1876645415836288:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 9160us (9677us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789708728.238194:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 210 00000100:00100000:1.0:1789708728.243948:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708728.244138:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415836672 00000100:00100000:0.0:1789708728.244150:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415836672 00000100:00100000:0.0:1789708728.244229:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:0.0:1789708728.244255:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+60:11589:x1876645415836672:12345-192.168.202.53@tcp:103:lfs.0 00010000:00010000:0.0:1789708728.244276:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708728.244315:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866ee2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b34 expref: 60 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.244335:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:0.0:1789708728.244341:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708728.244403:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+59:11589:x1876645415836672:12345-192.168.202.53@tcp:103:lfs.0 Request processed in 150us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708728.244410:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:1.0:1789708728.251290:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708728.251380:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415836800 00000100:00100000:0.0:1789708728.251392:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415836800 00000100:00100000:0.0:1789708728.251454:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 211 00000100:00100000:0.0:1789708728.251465:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+59:11589:x1876645415836800:12345-192.168.202.53@tcp:58:lfs.0 00010000:00010000:0.0:1789708728.251583:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866f91 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.251601:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866f91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.251613:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866f91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708728.251857:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789708728.251939:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+59:11589:x1876645415836800:12345-192.168.202.53@tcp:58:lfs.0 Request processed in 476us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708728.251948:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 211 00000100:00100000:1.0:1789708728.255747:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708728.255846:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415836928 00000100:00100000:3.0:1789708728.255856:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415836928 00000100:00100000:3.0:1789708728.255915:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 212 00000100:00100000:3.0:1789708728.255926:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+59:11589:x1876645415836928:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1789708728.255958:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708728.255980:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866f98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b65 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.256052:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866f91 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.256063:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866f98 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b65 expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.256091:0:5821:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866f91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.256126:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866f98 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b65 expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.256142:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:3.0:1789708728.256145:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789708728.256150:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866f98 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b65 expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.256159:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39c00, rc 0) 00000100:00100000:3.0:1789708728.256230:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+60:11589:x1876645415836928:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 306us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708728.256238:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 212 00000040:00080000:0.0:1789708728.314903:0:11657:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789708728.314916:0:11657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789708728.314964:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789708728.314978:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789708728.315447:0:11657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fa04a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11657:1876645426299904:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789708728.315632:0:11657:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1307f32540 going to sleep for 11 seconds 00000100:00100000:0.0:1789708728.324823:0:11657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fa04a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11657:1876645426299904:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789708728.327951:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708728.328305:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415837056 00000100:00100000:2.0:1789708728.328316:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415837056 00000100:00100000:2.0:1789708728.328386:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 213 00000100:00100000:2.0:1789708728.328398:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+60:11590:x1876645415837056:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789708728.328447:0:11601:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789708728.328585:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+60:11590:x1876645415837056:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 188us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708728.328593:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 213 00000100:00100000:1.0:1789708728.335584:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708728.335700:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415837184 00000100:00100000:3.0:1789708728.335719:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415837184 00000100:00100000:3.0:1789708728.335796:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 214 00000100:00100000:3.0:1789708728.335806:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+60:11590:x1876645415837184:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789708728.335893:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f9f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.335914:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f9f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.335928:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f9f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.335984:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866fa6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336025:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336032:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336059:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866fad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336067:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336083:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708728.336420:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789708728.336424:0:7140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789708728.336439:0:7140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336452:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f9f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336459:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f9f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336467:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f9f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336474:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708728.336479:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f9f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336497:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f9f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336511:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1411b4a700) 00010000:00010000:3.0:1789708728.336514:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708728.336520:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f9f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336527:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6866f9f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336543:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336550:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866fa6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336556:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336561:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708728.336564:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336569:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866fa6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336575:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8a1411b4aa00) 00010000:00010000:3.0:1789708728.336578:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708728.336580:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866fa6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336595:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866fa6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336610:0:7140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336615:0:7140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866fad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336621:0:7140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866fad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336626:0:7140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708728.336630:0:7140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866fad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336637:0:7140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866fad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336644:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:3.0:1789708728.336647:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708728.336703:0:7140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866fad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.336718:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866fad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708728.336808:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+60:11590:x1876645415837184:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 Request processed in 1002us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708728.336817:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 214 00000100:00100000:3.0:1789708728.340972:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708728.341204:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415837440 00000100:00100000:0.0:1789708728.341218:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415837440 00000100:00100000:0.0:1789708728.341301:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 215 00000100:00100000:0.0:1789708728.341314:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+60:11590:x1876645415837440:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708728.341339:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708728.341362:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866fb4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b6c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.341492:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866fbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.341509:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866fbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.341522:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866fbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708728.341535:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789708728.341716:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866fbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.341725:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866fbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.341752:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866fbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.341759:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708728.341763:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866fbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.341772:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866fbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.341787:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:0.0:1789708728.341791:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789708728.341797:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866fbb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.341803:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23200/0xa8f741d1c6866fbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.341854:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866fb4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b6c expref: 62 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.341864:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1411b4a700) 00010000:00010000:0.0:1789708728.341867:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789708728.341871:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23000/0xa8f741d1c6866fb4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b6c expref: 62 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.341880:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23000, rc 0) 00000100:00100000:0.0:1789708728.341943:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+61:11590:x1876645415837440:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 632us (983us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1789708728.341960:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 215 00000100:00100000:1.0:1789708728.353741:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708728.353855:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415837568 00000100:00100000:0.0:1789708728.353868:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415837568 00000100:00100000:0.0:1789708728.354401:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 216 00000100:00100000:0.0:1789708728.354413:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+61:11590:x1876645415837568:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789708728.354453:0:5819:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789708728.354595:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+61:11590:x1876645415837568:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 183us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708728.354603:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 216 00000100:00100000:3.0:1789708728.359592:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708728.362341:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415837824 00000100:00100000:1.0:1789708728.362363:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415837824 00000100:00100000:1.0:1789708728.362437:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 217 00000100:00100000:1.0:1789708728.362449:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+61:11590:x1876645415837824:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708728.362478:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708728.362481:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789708728.362512:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38200/0xa8f741d1c6866f59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b50 expref: 61 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.362534:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:1.0:1789708728.362540:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708728.362557:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c6866fc9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b73 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789708728.363574:0:5821:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1789708728.364384:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866fd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.364405:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.364420:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.364509:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4a00/0xa8f741d1c6866fc9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b73 expref: 63 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.364528:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b73 expref: 62 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.364538:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a14033c4b00) 00010000:00010000:1.0:1789708728.364542:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708728.364545:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5a00, rc 0) 00000100:00100000:1.0:1789708728.364724:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+62:11590:x1876645415837824:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 2276us (5144us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1789708728.364735:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 217 00000100:00100000:1.0:1789708728.373901:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708728.377384:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415838080 00000100:00100000:2.0:1789708728.377410:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415838080 00000100:00100000:2.0:1789708728.377614:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 218 00000100:00100000:2.0:1789708728.377626:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+62:11590:x1876645415838080:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789708728.377726:0:11601:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708728.377764:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5a00/0xa8f741d1c6866fd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b73 expref: 62 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.377789:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a14033c4b00) 00010000:00010000:2.0:1789708728.377802:0:11601:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708728.377827:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866fde lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.377843:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866fde lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.377853:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866fde lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.377890:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866fe5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x91298e32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.377898:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x91298e32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.377904:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x91298e32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.378011:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866fde lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.378019:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866fde lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.378027:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866fde lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.378033:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708728.378038:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866fde lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.378046:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866fde lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.378054:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:2.0:1789708728.378057:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708728.378060:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866fde lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.378066:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c6866fde lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.378104:0:11601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x91298e32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.378109:0:11601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866fe5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x91298e32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.378114:0:11601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866fe5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x91298e32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.378118:0:11601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6bc00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708728.378121:0:11601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866fe5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x91298e32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.378127:0:11601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866fe5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x91298e32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.378134:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x91298e32 (ffff8a1414c38400) 00010000:00010000:2.0:1789708728.378136:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708728.378139:0:11601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866fe5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x91298e32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.378144:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6866fe5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x91298e32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708728.378541:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+61:11590:x1876645415838080:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 915us (4651us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789708728.378551:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 218 00000100:00100000:0.0:1789708728.381884:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708728.382109:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415838208 00000100:00100000:3.0:1789708728.382123:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415838208 00000100:00100000:3.0:1789708728.382291:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 219 00000100:00100000:3.0:1789708728.382303:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+61:11590:x1876645415838208:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708728.382325:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708728.382351:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866fec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b7a expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.382393:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ff3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.382408:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.382421:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.382544:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866fec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b7a expref: 63 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.382566:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b7a expref: 62 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.382575:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1411b4aa00) 00010000:00010000:3.0:1789708728.382578:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789708728.382581:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38800, rc 0) 00000100:00100000:3.0:1789708728.382830:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+62:11590:x1876645415838208:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 529us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708728.382849:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 219 00000100:00100000:1.0:1789708728.391072:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708728.391217:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415838464 00000100:00100000:3.0:1789708728.391230:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415838464 00000100:00100000:3.0:1789708728.391295:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 220 00000100:00100000:3.0:1789708728.391305:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+62:11590:x1876645415838464:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789708728.391401:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866ffa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.391420:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866ffa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.391432:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866ffa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708728.391733:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:3.0:1789708728.391836:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2a7da24 reply state 000000002618201c transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866ffa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708728.391845:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789708728.391974:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+64:11590:x1876645415838464:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 669us (911us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1789708728.391986:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 220 00010000:00010000:3.0:1789708728.400638:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866ffa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.400681:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866ffa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.400689:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866ffa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.400727:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708728.400732:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866ffa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.400740:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866ffa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.400758:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1411b4aa00) 00010000:00010000:3.0:1789708728.400761:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789708728.400766:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866ffa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.400772:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6866ffa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708728.401938:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708728.402562:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415838592 00000100:00100000:2.0:1789708728.402572:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415838592 00000100:00100000:2.0:1789708728.402641:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 221 00000100:00100000:2.0:1789708728.402809:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+63:11590:x1876645415838592:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708728.402838:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708728.402860:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6867001 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b81 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.402933:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6867001 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b81 expref: 64 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.402963:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6867001 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b81 expref: 64 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.402985:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1411b4aa00) 00010000:00010000:2.0:1789708728.402989:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789708728.402993:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6bc00, rc 0) 00000100:00100000:2.0:1789708728.403070:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+64:11590:x1876645415838592:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 265us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708728.408146:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708728.408546:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415838720 00000100:00100000:3.0:1789708728.408557:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415838720 00000100:00100000:3.0:1789708728.408624:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 62 00000100:00100000:3.0:1789708728.408634:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+9:2361:x1876645415838720:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789708728.409099:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+10:2361:x1876645415838720:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 465us (964us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1789708728.409108:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 62 00000100:00100000:1.0:1789708728.412511:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708728.412594:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415838976 00000100:00100000:3.0:1789708728.412606:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415838976 00000100:00100000:0.0:1789708728.412847:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:0.0:1789708728.412860:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+65:11590:x1876645415838976:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789708728.413167:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+66:11590:x1876645415838976:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 309us (671us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789708728.413185:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:2.0:1789708728.413641:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 221 00000100:00100000:2.0:1789708728.416875:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708728.416964:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415839232 00000100:00100000:3.0:1789708728.416977:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415839232 00000100:00100000:3.0:1789708728.417050:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 222 00000100:00100000:3.0:1789708728.417061:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+65:11590:x1876645415839232:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789708728.417552:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+65:11590:x1876645415839232:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 491us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708728.417562:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 222 00000100:00100000:3.0:1789708728.421009:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708728.421292:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415839360 00000100:00100000:0.0:1789708728.421305:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415839360 00000100:00100000:0.0:1789708728.421387:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 223 00000100:00100000:0.0:1789708728.421399:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+65:11590:x1876645415839360:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708728.421426:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708728.421456:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6867008 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b88 expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.421556:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c686700f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.421576:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c686700f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.421587:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c686700f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708728.421623:0:7140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789708728.421640:0:7140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c686700f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.421731:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6867008 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b88 expref: 67 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.421750:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c686700f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b88 expref: 66 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.421758:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1411b4aa00) 00010000:00010000:0.0:1789708728.421761:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789708728.421764:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d22e00, rc 0) 00000100:00100000:0.0:1789708728.421830:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+66:11590:x1876645415839360:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 434us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708728.421837:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 223 00000100:00100000:0.0:1789708728.426273:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708728.426522:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415839488 00000100:00100000:2.0:1789708728.426532:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415839488 00000100:00100000:2.0:1789708728.426589:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:2.0:1789708728.426599:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a141080a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+10:2362:x1876645415839488:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708728.426621:0:10424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708728.426646:0:10424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000869a730d/0xa8f741d1c6867016 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b8f expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789708728.426717:0:10424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aacc9b8, blocks: 0x1 00010000:00010000:2.0:1789708728.426756:0:10424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=294s v=(0 0) 00010000:00010000:2.0:1789708728.426761:0:10424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708728.426772:0:10424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000869a730d/0xa8f741d1c6867016 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b8f expref: 11 pid: 10424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.426792:0:10424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000869a730d/0xa8f741d1c6867016 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b8f expref: 11 pid: 10424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.426808:0:10424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6b000, rc 0) 00000100:00100000:2.0:1789708728.426881:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a141080a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+11:2362:x1876645415839488:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 283us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708728.426890:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:2.0:1789708728.435590:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708728.436338:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415839744 00000100:00100000:0.0:1789708728.436351:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415839744 00000100:00100000:0.0:1789708728.436416:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 224 00000100:00100000:0.0:1789708728.436427:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1426d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+66:11590:x1876645415839744:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789708728.436547:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1426d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+66:11590:x1876645415839744:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 121us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708728.436569:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 224 00000100:00100000:3.0:1789708728.440638:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708728.440831:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415839872 00000100:00100000:2.0:1789708728.440844:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415839872 00000100:00100000:2.0:1789708728.440910:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 64 00000100:00100000:2.0:1789708728.440922:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+11:11590:x1876645415839872:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708728.440950:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708728.440974:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b650196/0xa8f741d1c686701d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b96 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.441022:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000869a730d/0xa8f741d1c6867016 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b8f expref: 12 pid: 10424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.441032:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708728.441037:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708728.441058:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b650196/0xa8f741d1c686701d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b96 expref: 12 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.441094:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000869a730d/0xa8f741d1c6867016 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b8f expref: 12 pid: 10424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.441108:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000869a730d/0xa8f741d1c6867016 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b8f expref: 12 pid: 10424 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708728.441123:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f270a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6673:1876645426300032:192.168.202.53@tcp:104: 00000100:00100000:2.0:1789708728.441219:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14089c7840 going to sleep for 11 seconds 00000100:00100000:1.0:1789708728.446515:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708728.447027:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f270a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6673:1876645426300032:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708728.447065:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003b650196/0xa8f741d1c686701d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b96 expref: 12 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.447100:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6be00, rc 0) 00000100:00100000:2.0:1789708728.447183:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+12:11590:x1876645415839872:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 6262us (6554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708728.447194:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 64 00000100:00100000:0.0:1789708728.449467:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415840000 00000100:00100000:0.0:1789708728.449483:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415840000 00010000:00010000:0.0:1789708728.449532:0:5805:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000869a730d/0xa8f741d1c6867016 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b8f expref: 12 pid: 10424 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708728.449578:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 77 00000100:00100000:0.0:1789708728.449588:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+12:2362:x1876645415840000:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708728.449604:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708728.449627:0:5805:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000869a730d/0xa8f741d1c6867016 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b8f expref: 12 pid: 10424 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.449640:0:5805:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000869a730d/0xa8f741d1c6867016 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b8f expref: 12 pid: 10424 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.449679:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000869a730d/0xa8f741d1c6867016 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b8f expref: 12 pid: 10424 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.449695:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708728.449700:0:5805:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708728.449717:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b650196/0xa8f741d1c686701d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b96 expref: 11 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.449727:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b650196/0xa8f741d1c686701d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b96 expref: 11 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.449790:0:5805:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003b650196/0xa8f741d1c686701d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b96 expref: 11 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708728.449804:0:5805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4d9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5805:1876645426300160:192.168.202.53@tcp:105: 00000100:00100000:0.0:1789708728.449895:0:5805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1307f32d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708728.453480:0:5805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4d9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5805:1876645426300160:192.168.202.53@tcp:105: 00010000:00010000:0.0:1789708728.453518:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708728.453583:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+11:2362:x1876645415840000:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 3995us (7081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708728.453595:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 77 00000100:00100000:1.0:1789708728.457759:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708728.457850:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415840128 00000100:00100000:3.0:1789708728.457861:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415840128 00002000:00100000:3.0:1789708728.457917:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8a143f4e4e00 x1876645415840128/t0(0) o4->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:114/0 lens 504/0 e 0 to 0 dl 1789708739 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789708728.457929:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a143f4e4e00 with x1876645415840128 ext(0->12) 00002000:00010000:3.0:1789708728.457935:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a143f4e4e00 00000100:00100000:3.0:1789708728.457973:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:3.0:1789708728.457983:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+11:2362:x1876645415840128:12345-192.168.202.53@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789708728.458737:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+13:2362:x1876645415840128:12345-192.168.202.53@tcp:4:lhsmtool_posix.0 Request processed in 752us (987us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789708728.458747:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00002000:00100000:3.0:1789708728.458755:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8a143f4e4e00 x1876645415840128/t4294967320(0) o4->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:114/0 lens 504/448 e 0 to 0 dl 1789708739 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789708728.458765:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a143f4e4e00 with x1876645415840128 ext(0->12) 00002000:00010000:3.0:1789708728.458769:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a143f4e4e00 00000100:00100000:3.0:1789708728.462097:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708728.462496:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415840256 00000100:00100000:0.0:1789708728.462507:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415840256 00000100:00100000:0.0:1789708728.462570:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 225 00000100:00100000:0.0:1789708728.462580:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+66:11590:x1876645415840256:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789708728.499635:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:3.0:1789708728.499697:0:5841:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a1308463480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1789708728.499720:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1410624c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a1308463840 00000020:00080000:3.0:1789708728.499739:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1410624200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a1403669400 00000020:00080000:2.0:1789708728.499780:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 6 committed batchid 5 00000020:00080000:2.0:1789708728.499978:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:3.0:1789708728.500510:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789708728.500538:0:5841:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a1407e23a80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789708728.500542:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a14051ba200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a1407e23d80 00000020:00080000:3.0:1789708728.500545:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a14051bab00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a143f494800 00000004:00080000:3.0:1789708728.500561:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:1.0:1789708728.500731:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+20:11590:x1876645415840256:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 Request processed in 38147us (38641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708728.500743:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 225 00000100:00100000:2.0:1789708728.500923:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00080000:0.0:1789708728.501077:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789708728.501113:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789708728.501401:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708728.501412:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426300416:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789708728.501476:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708728.501551:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426300416 00000100:00100000:1.0:1789708728.501559:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426300416 00000100:00100000:1.0:1789708728.501600:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789708728.501607:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1876645426300416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789708728.501635:0:6670:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1789708728.501683:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6867024 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.501715:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866de6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4af5 expref: 12 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.501725:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789708728.501729:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708728.501734:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6867024 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.501764:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866de6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4af5 expref: 12 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.501778:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866de6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4af5 expref: 12 pid: 6670 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708728.501789:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1876645426300544:192.168.202.53@tcp:104: 00000100:00100000:1.0:1789708728.501833:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14051bb180 going to sleep for 11 seconds 00000100:00100000:2.0:1789708728.502840:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426300288:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789708728.502901:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708728.504686:0:11993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426300288 00000100:00100000:1.0:1789708728.504699:0:11993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426300288 00000100:00100000:1.0:1789708728.504770:0:11993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789708728.504797:0:11993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f270700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3287:x1876645426300288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789708728.504834:0:11993:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1789708728.504875:0:11993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aacc9b7, atime: 0x6aacc9b8, ctime: 0x6aacc9b7, blocks: 0x1 00010000:00010000:1.0:1789708728.504883:0:11993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c686702b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.504902:0:11993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=294s v=(0 0) 00010000:00010000:1.0:1789708728.504906:0:11993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708728.504914:0:11993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c686702b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.504931:0:11993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c686702b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.504941:0:11993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c686702b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.504950:0:11993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c686702b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.504974:0:11993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708728.505548:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708728.505556:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c686702b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.505565:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5000 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708728.505570:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c686702b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.505592:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c686702b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.505610:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c686702b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.505616:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c686702b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.505637:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708728.505638:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708728.505640:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708728.508213:0:11993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f270700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3287:x1876645426300288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3412us (5305us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789708728.508227:0:11993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789708728.508363:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708728.508507:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415840384 00000100:00100000:3.0:1789708728.508515:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415840384 00000100:00100000:3.0:1789708728.508559:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 67 00000100:00100000:3.0:1789708728.508567:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+13:2361:x1876645415840384:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1789708728.508764:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a143f270a80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789708728.508771:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426300288:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789708728.509699:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6670:1876645426300544:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708728.509738:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6867024 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708728.511690:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708728.514489:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415840512 00000100:00100000:1.0:1789708728.514504:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415840512 00010000:00010000:1.0:1789708728.514550:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866de6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4af5 expref: 14 pid: 6670 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708728.514623:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 78 00000100:00100000:1.0:1789708728.514633:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427030380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+14:2362:x1876645415840512:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708728.514672:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708728.514679:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866de6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4af5 expref: 14 pid: 6670 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.514694:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866de6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4af5 expref: 14 pid: 6670 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.514731:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e078f9e8/0xa8f741d1c6866de6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4af5 expref: 14 pid: 6670 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.514749:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708728.514755:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708728.514761:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6867024 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.514772:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6867024 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.514801:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708728.514860:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427030380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+13:2362:x1876645415840512:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 229us (3178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708728.514869:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 78 00010000:00010000:1.0:1789708728.514903:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6867024 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.514913:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6867024 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.514924:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6867024 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.514932:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6867024 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.514966:0:6670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789708728.515570:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3286:x1876645426300416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13961us (14091us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789708728.515579:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:1.0:1789708728.515603:0:8433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708728.515610:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6867024 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.515619:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4400 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708728.515624:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6867024 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.515633:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6867024 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.515690:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6867024 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.515698:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000492815dc/0xa8f741d1c6867024 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.515732:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708728.515734:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708728.515736:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789708728.515778:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a143f4d9f80/2, rc 0, transno 4294967321 00000100:00100000:1.0:1789708728.515793:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426300416:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789708728.552572:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+12:2361:x1876645415840384:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 Request processed in 43989us (44195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708728.552588:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 67 00000100:00100000:3.0:1789708728.555674:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708728.555739:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415840768 00000100:00100000:3.0:1789708728.555751:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415840768 00000100:00100000:3.0:1789708728.555824:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 226 00000100:00100000:3.0:1789708728.555837:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+20:11590:x1876645415840768:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789708728.555909:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708728.556483:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22e00/0xa8f741d1c686700f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b88 expref: 20 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.556506:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1411b4aa00) 00010000:00010000:3.0:1789708728.556511:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708728.556547:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6867032 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.556560:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6867032 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.556579:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6867032 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708728.556872:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004766c4d4 reply state 0000000078aaa778 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6867032 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708728.556882:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789708728.557434:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:1.0:1789708728.557447:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:1.0:1789708728.557458:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:3.0:1789708728.557515:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+21:11590:x1876645415840768:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 1678us (1867us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1789708728.557525:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 226 00000100:00100000:3.0:1789708728.564869:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00010000:00010000:1.0:1789708728.565209:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6867032 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.565224:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6867032 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.565232:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6867032 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.565239:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708728.565244:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6867032 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.565252:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6867032 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.565288:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1411b4aa00) 00010000:00010000:1.0:1789708728.565291:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708728.565296:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6867032 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.565302:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38c00/0xa8f741d1c6867032 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708728.565413:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415840896 00000100:00100000:0.0:1789708728.565424:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415840896 00000100:00100000:0.0:1789708728.565483:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 68 00000100:00100000:0.0:1789708728.565493:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2362:x1876645415840896:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789708728.565827:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789708728.565831:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789708728 00002000:00010000:0.0:1789708728.565833:0:6672:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789708728 00002000:00010000:0.0:1789708728.565834:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789708728 -> 1789708728 00002000:00010000:0.0:1789708728.565837:0:6672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789708728.565953:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2362:x1876645415840896:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 459us (1095us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789708728.565962:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 68 00000100:00100000:2.0:1789708728.569432:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708728.569511:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415841152 00000100:00100000:3.0:1789708728.569521:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415841152 00000100:00100000:3.0:1789708728.569611:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 227 00000100:00100000:3.0:1789708728.569621:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+20:11590:x1876645415841152:12345-192.168.202.53@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789708728.569729:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867039 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.569747:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ff3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b7a expref: 20 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.569756:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867039 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.569794:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b7a expref: 20 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.569808:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ff3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b7a expref: 20 pid: 5819 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708728.569838:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1876645426300672:192.168.202.53@tcp:104: 00000100:00100000:3.0:1789708728.569920:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405102240 going to sleep for 11 seconds 00000100:00100000:2.0:1789708728.576528:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1876645426300672:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708728.576560:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867039 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708728.579848:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708728.580644:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415841280 00000100:00100000:1.0:1789708728.580684:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415841280 00010000:00010000:1.0:1789708728.580733:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ff3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b7a expref: 21 pid: 5819 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708728.580767:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 79 00000100:00100000:1.0:1789708728.580776:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1407f57c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+21:2361:x1876645415841280:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708728.580791:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708728.580797:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ff3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b7a expref: 21 pid: 5819 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.580809:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b7a expref: 21 pid: 5819 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.580832:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38800/0xa8f741d1c6866ff3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b7a expref: 21 pid: 5819 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.580846:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1411b4aa00) 00010000:00010000:1.0:1789708728.580851:0:8435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867039 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.580878:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.580887:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867039 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.580919:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708728.580989:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1407f57c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+20:2361:x1876645415841280:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 213us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708728.581007:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 79 00010000:00010000:2.0:1789708728.581212:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.581220:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.581251:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.581257:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867039 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.581264:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867039 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.581269:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708728.581281:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867039 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.581289:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867039 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.581298:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1411b4aa00) 00010000:00010000:2.0:1789708728.581301:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789708728.581304:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867039 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.581310:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867039 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708728.581366:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+19:11590:x1876645415841152:12345-192.168.202.53@tcp:55:lhsmtool_posix.0 Request processed in 11747us (11944us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789708728.581374:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 227 00000100:00100000:3.0:1789708728.585219:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708728.585302:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415841408 00000100:00100000:1.0:1789708728.585312:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415841408 00000100:00100000:1.0:1789708728.585377:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:1.0:1789708728.585387:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2362:x1876645415841408:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789708728.585440:0:10424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c6867040 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.585462:0:10424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b650196/0xa8f741d1c686701d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b96 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.585472:0:10424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708728.585477:0:10424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708728.585482:0:10424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c6867040 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.585519:0:10424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b650196/0xa8f741d1c686701d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b96 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.585552:0:10424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b650196/0xa8f741d1c686701d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b96 expref: 8 pid: 6673 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708728.585567:0:10424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10424:1876645426300800:192.168.202.53@tcp:104: 00000100:00100000:1.0:1789708728.585684:0:10424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1403040a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708728.589643:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708728.589699:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415841536 00000100:00100000:1.0:1789708728.589717:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415841536 00010000:00010000:1.0:1789708728.589755:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b650196/0xa8f741d1c686701d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b96 expref: 9 pid: 6673 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708728.589793:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 80 00000100:00100000:1.0:1789708728.589803:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+9:2361:x1876645415841536:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708728.589819:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708728.589844:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b650196/0xa8f741d1c686701d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b96 expref: 9 pid: 6673 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.589857:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b650196/0xa8f741d1c686701d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b96 expref: 9 pid: 6673 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.589882:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708728.589887:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708728.589893:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c6867040 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.589918:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c6867040 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.589959:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708728.590023:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+9:2361:x1876645415841536:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 221us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708728.590031:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 80 00010000:00010000:3.0:1789708728.590226:0:10424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b650196/0xa8f741d1c686701d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b96 expref: 8 pid: 6673 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708728.590243:0:10424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10424:1876645426300800:192.168.202.53@tcp:104: 00010000:00010000:3.0:1789708728.590264:0:10424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c6867040 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.590275:0:10424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c6867040 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.590284:0:10424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c6867040 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.590308:0:10424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c6867040 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.590316:0:10424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c6867040 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.590324:0:10424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c6867040 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.590341:0:10424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4c00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708728.590346:0:10424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c6867040 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.590355:0:10424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c6867040 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.590366:0:10424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c6867040 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.590373:0:10424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047b45df7/0xa8f741d1c6867040 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708728.590430:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2362:x1876645415841408:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 Request processed in 5044us (5221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708728.590437:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:1.0:1789708728.594081:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708728.594167:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415841792 00000100:00100000:0.0:1789708728.594188:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415841792 00000100:00100000:0.0:1789708728.594247:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 228 00000100:00100000:0.0:1789708728.594258:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+19:11590:x1876645415841792:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789708728.594340:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6867047 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.594356:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6867047 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.594369:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6867047 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.594567:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686704e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.594577:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6867001 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b81 expref: 20 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.594587:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686704e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.594620:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6867001 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b81 expref: 20 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.594632:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6867001 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b81 expref: 20 pid: 11601 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708728.594645:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4da300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1876645426300928:192.168.202.53@tcp:104: 00000100:00100000:0.0:1789708728.594770:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140319f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789708728.597842:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4da300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1876645426300928:192.168.202.53@tcp:104: 00010000:00010000:0.0:1789708728.597875:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686704e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708728.598703:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708728.598953:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415841920 00000100:00100000:3.0:1789708728.598962:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415841920 00010000:00010000:3.0:1789708728.599011:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6867001 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b81 expref: 21 pid: 11601 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708728.599048:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 81 00000100:00100000:3.0:1789708728.599058:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+21:2362:x1876645415841920:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708728.599073:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708728.599101:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6867001 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b81 expref: 21 pid: 11601 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.599113:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6867001 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b81 expref: 21 pid: 11601 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.599136:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6bc00/0xa8f741d1c6867001 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b81 expref: 21 pid: 11601 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.599150:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1411b4aa00) 00010000:00010000:3.0:1789708728.599155:0:8435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686704e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.599163:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686704e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.599180:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686704e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708728.599209:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708728.599258:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+20:2362:x1876645415841920:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 201us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708728.599266:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 81 00010000:00010000:1.0:1789708728.599595:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686704e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.599602:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686704e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789708728.603203:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1789708728.603390:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1789708728.603438:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1789708728.603548:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5819:1876645426301056:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789708728.603642:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708728.603715:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f9053c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708728.604216:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426301056 00000100:00100000:3.0:1789708728.604226:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426301056 00000100:00100000:3.0:1789708728.604300:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789708728.604311:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5819:x1876645426301056:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789708728.604398:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5819:x1876645426301056:12345-0@lo:1000:mdt00_000.0 Request processed in 89us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708728.604419:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789708728.604632:0:5819:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:1.0:1789708728.604638:0:5819:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:1.0:1789708728.604702:0:5819:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a143f4d9f80 x1876645426300416/t4294967321(4294967321) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789708744 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708728.604726:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5819:1876645426301056:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789708728.605562:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1789708728.605644:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5819:1876645426301184:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789708728.605736:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708728.605764:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f9050c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708728.605845:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426301184 00000100:00100000:3.0:1789708728.605852:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426301184 00000100:00100000:3.0:1789708728.605895:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789708728.605903:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5819:x1876645426301184:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789708728.606098:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5819:x1876645426301184:12345-0@lo:1000:mdt00_000.0 Request processed in 195us (360us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789708728.606106:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789708728.606840:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5819:1876645426301184:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789708728.606883:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686704e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.606893:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686704e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.606902:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686704e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.606909:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23a00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708728.606913:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686704e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.606922:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686704e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.606939:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1411b4aa00) 00010000:00010000:1.0:1789708728.606942:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708728.606947:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686704e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.606954:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c686704e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.606988:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866f91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.607524:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866f91 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.607531:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866f91 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.607537:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708728.607540:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866f91 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.607547:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866f91 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.607557:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:1.0:1789708728.607559:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708728.607567:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866f98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b65 expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.607578:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866f98 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b65 expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.607587:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866f98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b65 expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.607625:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866f98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b65 expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708728.607639:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130a1dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1876645426301312:192.168.202.53@tcp:105: 00000100:00100000:1.0:1789708728.607782:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1410bda300 going to sleep for 11 seconds 00000100:00100000:2.0:1789708728.612025:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708728.612357:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415842048 00000100:00100000:0.0:1789708728.612370:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415842048 00000100:00100000:0.0:1789708728.612432:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:0.0:1789708728.612443:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+24:11589:x1876645415842048:12345-192.168.202.53@tcp:49:lfs.0 00000100:00100000:0.0:1789708728.612576:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+24:11589:x1876645415842048:12345-192.168.202.53@tcp:49:lfs.0 Request processed in 134us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708728.612584:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:0.0:1789708728.612633:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130a1dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5819:1876645426301312:192.168.202.53@tcp:105: 00010000:00010000:0.0:1789708728.612678:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866f91 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.612689:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22600/0xa8f741d1c6866f91 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.612737:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6867055 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.612752:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6867055 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.612762:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6867055 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.612771:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6867055 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.612794:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6867055 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.612800:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6867055 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.612807:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708728.612811:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6867055 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.612817:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6867055 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.612830:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:0.0:1789708728.612833:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708728.612837:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6867055 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.612842:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23c00/0xa8f741d1c6867055 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.612853:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6867047 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.612858:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6867047 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.612864:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6867047 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.612869:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22a00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708728.612878:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6867047 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.612884:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6867047 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.612891:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:0.0:1789708728.612893:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789708728.612896:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6867047 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.612901:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c6867047 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708728.613318:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+23:11590:x1876645415841792:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 19060us (19243us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1789708728.613330:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 228 00000020:00080000:0.0:1789708728.613336:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789708728.613484:0:11657:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789708728.613489:0:11657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789708728.616073:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789708728.616118:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789708728.618891:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708728.618972:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415842304 00000100:00100000:2.0:1789708728.618984:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415842304 00000100:00100000:2.0:1789708728.619054:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 62 00000100:00100000:2.0:1789708728.619064:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14069fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+23:11590:x1876645415842304:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789708728.619770:0:5823:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789708728.619881:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1789708728.619926:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686705c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.619940:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686705c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.619951:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686705c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.619967:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686705c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.619974:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686705c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.619979:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686705c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.619999:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789708728.620094:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14069fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+25:11590:x1876645415842304:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 1029us (1210us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789708728.620104:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 62 00000020:00080000:2.0:1789708728.620109:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789708728.620423:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708728.620430:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686705c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.620439:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a000 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708728.620442:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686705c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.620461:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686705c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.620474:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:0.0:1789708728.620478:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789708728.620483:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686705c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.620489:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a000/0xa8f741d1c686705c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708728.620510:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708728.620512:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708728.620513:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708728.625402:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708728.625497:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415842560 00000100:00100000:3.0:1789708728.625510:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415842560 00000100:00100000:3.0:1789708728.625593:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 229 00000100:00100000:3.0:1789708728.625605:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+25:11589:x1876645415842560:12345-192.168.202.53@tcp:58:lfs.0 00000040:00080000:3.0:1789708728.625969:0:11601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789708728.626075:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+25:11589:x1876645415842560:12345-192.168.202.53@tcp:58:lfs.0 Request processed in 471us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708728.626094:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 229 00000100:00100000:3.0:1789708728.667577:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708728.667898:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415842688 00000100:00100000:1.0:1789708728.667910:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415842688 00000100:00100000:1.0:1789708728.668001:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 230 00000100:00100000:1.0:1789708728.668011:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+25:11593:x1876645415842688:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1789708728.668036:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708728.668058:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4000/0xa8f741d1c6867063 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4b9d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.668484:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686706a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.668501:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686706a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.668513:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686706a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.668530:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6867071 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.668537:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6867071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.668544:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6867071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.668831:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6867078 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.668842:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866f83 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b5e expref: 26 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.668858:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6867078 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.668893:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866f83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b5e expref: 26 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.668905:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866f83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b5e expref: 26 pid: 11601 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708728.668920:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130a1df100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1876645426301440:192.168.202.53@tcp:104: 00000100:00100000:1.0:1789708728.670167:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405102b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708728.678016:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708728.678050:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415842944 00000100:00100000:1.0:1789708728.678059:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415842944 00000100:00100000:1.0:1789708728.678122:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:1.0:1789708728.678132:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+27:5591:x1876645415842944:12345-192.168.202.53@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789708728.678378:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+28:5591:x1876645415842944:12345-192.168.202.53@tcp:35:ldlm_bl.0 Request processed in 246us (373us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1789708728.678386:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:3.0:1789708728.680534:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708728.680586:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130a1df100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5821:1876645426301440:192.168.202.53@tcp:104: 00010000:00010000:3.0:1789708728.680610:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6867078 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708728.680935:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415843072 00000100:00100000:1.0:1789708728.680950:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415843072 00010000:00010000:1.0:1789708728.680988:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866f83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b5e expref: 28 pid: 11601 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708728.681030:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 82 00000100:00100000:1.0:1789708728.681038:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+28:2361:x1876645415843072:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708728.681068:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708728.681074:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866f83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b5e expref: 28 pid: 11601 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.681095:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866f83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b5e expref: 28 pid: 11601 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.681119:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ac00/0xa8f741d1c6866f83 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b5e expref: 28 pid: 11601 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.681134:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:1.0:1789708728.681139:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6867078 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.681148:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6867078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.681157:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6867078 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708728.681426:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708728.681471:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+27:2361:x1876645415843072:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 433us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708728.681479:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 82 00010000:00010000:2.0:1789708728.682713:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6867078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.682724:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6867078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708728.682772:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789708728.682776:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789708728.682797:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6867078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.682813:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6867078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.682823:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686706a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.682841:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686706a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.682847:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686706a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.682854:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708728.682858:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686706a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.682866:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686706a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.682879:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:2.0:1789708728.682882:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708728.682886:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686706a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.682891:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5800/0xa8f741d1c686706a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.682904:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6867071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.682909:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6867071 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.682915:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6867071 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.682919:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708728.682928:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6867071 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.682934:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6867071 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.682942:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a14033c4d00) 00010000:00010000:2.0:1789708728.682944:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708728.682947:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6867071 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.682952:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4c00/0xa8f741d1c6867071 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.682990:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4000/0xa8f741d1c6867063 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b9d expref: 27 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.683015:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6867078 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b9d expref: 26 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708728.683023:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:2.0:1789708728.683025:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708728.683028:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5600, rc 0) 00000100:00100000:2.0:1789708728.683082:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+26:11593:x1876645415842688:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 15072us (15518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708728.683097:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 230 00000001:00080000:0.0:1789708728.709599:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1789708728.709621:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:0.0:1789708728.763681:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789708729.477350:0:12488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789708729.477358:0:12488:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708729.477417:0:12488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789708729.477430:0:12488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789708729.659944:0:11657:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789708729.659955:0:11657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789708729.660019:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789708729.660033:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789708729.660166:0:11657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4da300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11657:1876645426301568:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789708729.660275:0:11657:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1407e23c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708729.665018:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708729.666184:0:11657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4da300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11657:1876645426301568:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789708729.669850:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415843200 00000100:00100000:0.0:1789708729.669867:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415843200 00000100:00100000:0.0:1789708729.669937:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 231 00000100:00100000:0.0:1789708729.669948:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a1df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+26:11605:x1876645415843200:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789708729.670002:0:5819:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789708729.670122:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a1df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+26:11605:x1876645415843200:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 175us (5114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708729.670130:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 231 00000100:00100000:3.0:1789708729.675387:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708729.675623:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415843456 00000100:00100000:0.0:1789708729.675634:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415843456 00000100:00100000:0.0:1789708729.675738:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 232 00000100:00100000:0.0:1789708729.675751:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+26:11605:x1876645415843456:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708729.675775:0:7140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708729.675807:0:7140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c686707f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4ba4 expref: -99 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708729.675916:0:7140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6867086 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708729.675930:0:7140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6867086 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708729.675944:0:7140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6867086 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708729.675955:0:7140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789708729.676331:0:7140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23800/0xa8f741d1c686707f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ba4 expref: 29 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708729.676355:0:7140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6867086 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ba4 expref: 28 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708729.676389:0:7140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:0.0:1789708729.676392:0:7140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789708729.676396:0:7140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23e00, rc 0) 00000100:00100000:0.0:1789708729.676467:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+28:11605:x1876645415843456:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 718us (1089us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789708729.676476:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 232 00000100:00100000:0.0:1789708729.694969:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708729.695078:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708729.695965:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415843712 00000100:00100000:3.0:1789708729.695978:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415843712 00000100:00100000:3.0:1789708729.696054:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 233 00000100:00100000:3.0:1789708729.696064:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+28:11605:x1876645415843712:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789708729.696156:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867094 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708729.696183:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708729.696200:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708729.696381:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708729.696390:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867094 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708729.696397:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708729.696403:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708729.696407:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708729.696415:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867094 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708729.696427:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:3.0:1789708729.696430:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789708729.696435:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867094 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708729.696441:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c6867094 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708729.696593:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+29:11605:x1876645415843712:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 529us (1633us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1789708729.696601:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 233 00000100:00100000:3.0:1789708729.696628:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415843840 00000100:00100000:3.0:1789708729.696632:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415843840 00000100:00100000:3.0:1789708729.696680:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:3.0:1789708729.696687:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+29:2363:x1876645415843840:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708729.696713:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708729.696730:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23e00/0xa8f741d1c6867086 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ba4 expref: 29 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708729.696742:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:3.0:1789708729.696746:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708729.696766:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+28:2363:x1876645415843840:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 80us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708729.696772:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000040:00080000:3.0:1789708729.698611:0:11657:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789708729.698620:0:11657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789708729.700385:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789708729.700413:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789708729.705642:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708729.705915:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415844096 00000100:00100000:1.0:1789708729.705925:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415844096 00000100:00100000:1.0:1789708729.706069:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 64 00000100:00100000:1.0:1789708729.706082:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+28:11605:x1876645415844096:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789708729.706353:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+29:11605:x1876645415844096:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 273us (720us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789708729.711427:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 64 00010000:00010000:2.0:1789708729.793095:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708730.810797:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789708731.482313:0:12539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789708731.482321:0:12539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789708731.482386:0:12539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789708731.482398:0:12539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789708731.646210:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708731.646258:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708731.646288:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708731.646323:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708731.646350:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708731.646380:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415844480 00000100:00100000:2.0:1789708731.646390:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415844480 00000100:00100000:2.0:1789708731.646454:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415844608 00000100:00100000:2.0:1789708731.646458:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415844608 00000100:00100000:2.0:1789708731.646483:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:2.0:1789708731.646493:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2364:x1876645415844480:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708731.646573:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2364:x1876645415844480:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 80us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708731.646581:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:2.0:1789708731.646601:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:2.0:1789708731.646608:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2364:x1876645415844608:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708731.646634:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2364:x1876645415844608:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 27us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708731.646641:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00080000:2.0:1789708731.646729:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789708731.646734:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708731.646867:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415844736 00000100:00100000:0.0:1789708731.646872:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415844736 00000100:00100000:0.0:1789708731.646923:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415844352 00000100:00100000:0.0:1789708731.646927:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415844352 00000100:00100000:0.0:1789708731.646951:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 117 00000100:00100000:0.0:1789708731.646959:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f53ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c9d2a103-cf70-4470-bdd0-387470668318+5:2364:x1876645415844736:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708731.646994:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f53ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c9d2a103-cf70-4470-bdd0-387470668318+5:2364:x1876645415844736:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 36us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708731.647002:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 117 00000100:00100000:0.0:1789708731.647016:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 118 00000100:00100000:0.0:1789708731.647023:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+29:2364:x1876645415844352:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708731.647057:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+29:2364:x1876645415844352:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 34us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708731.647063:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 118 00000100:00080000:2.0:1789708731.647327:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708731.647390:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415844224 00000100:00100000:3.0:1789708731.647395:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415844224 00000100:00100000:3.0:1789708731.647454:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 279 00000100:00100000:3.0:1789708731.647462:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2364:x1876645415844224:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708731.647505:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2364:x1876645415844224:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 44us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708731.647511:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 279 00000100:00100000:2.0:1789708731.687988:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708731.688082:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415844992 00000100:00100000:0.0:1789708731.688104:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415844992 00000100:00100000:0.0:1789708731.688181:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 234 00000100:00100000:0.0:1789708731.688193:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+29:11625:x1876645415844992:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1789708731.688216:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708731.688238:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c686709b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4bab expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708731.688359:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c68670a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708731.688377:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c68670a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708731.688390:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c68670a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708731.688401:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789708731.688565:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22a00/0xa8f741d1c686709b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4bab expref: 32 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708731.688580:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c68670a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4bab expref: 31 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708731.688589:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:0.0:1789708731.688593:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789708731.688596:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23a00, rc 0) 00000100:00100000:0.0:1789708731.688645:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+31:11625:x1876645415844992:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 455us (666us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789708731.688784:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 234 00000100:00100000:3.0:1789708731.693999:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708731.694107:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415845120 00000100:00100000:1.0:1789708731.694121:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415845120 00000100:00100000:1.0:1789708731.694181:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 235 00000100:00100000:1.0:1789708731.694192:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+31:11625:x1876645415845120:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:1.0:1789708731.694265:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c68670b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708731.694284:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c68670b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708731.694295:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c68670b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708731.694328:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c68670b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708731.694336:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c68670b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708731.694344:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c68670b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708731.694363:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708731.694368:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c68670b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708731.694376:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c68670b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708731.694389:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:1.0:1789708731.694392:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708731.694398:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c68670b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708731.694405:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5200/0xa8f741d1c68670b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708731.694474:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+31:11625:x1876645415845120:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 284us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708731.694482:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 235 00000100:00100000:3.0:1789708731.767433:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708731.767570:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415845248 00000100:00100000:1.0:1789708731.767581:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415845248 00000100:00100000:1.0:1789708731.767692:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 70 00000100:00100000:1.0:1789708731.767703:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2361:x1876645415845248:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:1.0:1789708731.767723:0:10424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708731.782073:0:10424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000988150dc/0xa8f741d1c68670b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4bb2 expref: -99 pid: 10424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789708731.782120:0:10424:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aacc9b8, atime: 0x6aacc9b8, ctime: 0x6aacc9b8, blocks: 0xb 00010000:00010000:0.0:1789708731.782535:0:10424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=297s v=(0 0) 00010000:00010000:0.0:1789708731.782542:0:10424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708731.782555:0:10424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000988150dc/0xa8f741d1c68670b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4bb2 expref: 8 pid: 10424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708731.782578:0:10424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000988150dc/0xa8f741d1c68670b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4bb2 expref: 8 pid: 10424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708731.782595:0:10424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d22a00, rc 0) 00000100:00100000:0.0:1789708731.782780:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2361:x1876645415845248:12345-192.168.202.53@tcp:101:cat.0 Request processed in 15077us (15355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708731.782789:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 70 00000100:00100000:1.0:1789708731.795017:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708731.795325:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415845376 00000100:00100000:0.0:1789708731.795335:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415845376 00002000:00100000:0.0:1789708731.795386:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8a140366ca80 x1876645415845376/t0(0) o3->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:117/0 lens 488/0 e 0 to 0 dl 1789708742 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789708731.795398:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a140366ca80 with x1876645415845376 ext(0->4095) 00002000:00010000:0.0:1789708731.795403:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a140366ca80 00000100:00100000:0.0:1789708731.795435:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:0.0:1789708731.795444:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2362:x1876645415845376:12345-192.168.202.53@tcp:3:cat.0 00000100:00100000:0.0:1789708731.795733:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+8:2362:x1876645415845376:12345-192.168.202.53@tcp:3:cat.0 Request processed in 289us (726us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789708731.795757:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00002000:00100000:0.0:1789708731.795765:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8a140366ca80 x1876645415845376/t0(0) o3->14bb7f14-3461-47f6-86c9-db3f545050ad@192.168.202.53@tcp:117/0 lens 488/4536 e 0 to 0 dl 1789708742 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789708731.795774:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a140366ca80 with x1876645415845376 ext(0->4095) 00002000:00010000:0.0:1789708731.795778:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a140366ca80 00010000:00010000:0.0:1789708731.834910:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708732.668856:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789708732.668881:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426301696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708732.668960:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708732.669156:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426301696 00000100:00100000:3.0:1789708732.669165:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426301696 00000100:00100000:3.0:1789708732.669236:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789708732.669245:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426301696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789708732.669279:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708732.669338:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426301696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708732.669346:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1789708732.669399:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708732.669425:0:3289:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789708732.669443:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a143e958a80, transno 4294967307 00000004:00080000:1.0:1789708732.669470:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1789708732.669497:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a143f270a80, transno 4294967310 00000100:00100000:1.0:1789708732.669516:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426301696:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789708732.859357:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708733.178908:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708733.179023:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876645426302208:0@lo:400:kworker.0 00000100:00100000:0.0:1789708733.179102:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789708733.179135:0:7748:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 298976483106ns, next at 299976479408ns, rc = 0 00000100:00100000:0.0:1789708733.179159:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130a5ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426301824:0@lo:400:kworker.0 00000100:00100000:3.0:1789708733.179166:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426302208 00000100:00100000:3.0:1789708733.179174:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426302208 00000100:00100000:0.0:1789708733.179192:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708733.179220:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789708733.179227:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426302336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789708733.179256:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708733.179261:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789708733.179273:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876645426302208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708733.179284:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426301824 00000100:00100000:0.0:1789708733.179288:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426301824 00000100:00100000:0.0:1789708733.179313:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789708733.179319:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3288:x1876645426301824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708733.179349:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876645426302208:12345-0@lo:400:kworker.0 Request processed in 77us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708733.179354:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3288:x1876645426301824:12345-0@lo:400:kworker.0 Request processed in 34us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708733.179365:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789708733.179366:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1789708733.179394:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708733.179397:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426302336 00000100:00100000:0.0:1789708733.179400:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426302336 00000100:00080000:3.0:1789708733.179421:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789708733.179429:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789708733.179442:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1876645426302336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789708733.179468:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708733.179473:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876645426302208:0@lo:400:kworker.0 00000100:00100000:3.0:1789708733.179499:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130a5ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426301824:0@lo:400:kworker.0 00000100:00100000:0.0:1789708733.179508:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1876645426302336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708733.179517:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789708733.179535:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426302336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708733.179750:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426301952:0@lo:400:kworker.0 00000100:00100000:1.0:1789708733.179783:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708733.179807:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708733.179813:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426302080:0@lo:400:kworker.0 00000100:00100000:1.0:1789708733.179834:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708733.179865:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426301952 00000100:00100000:1.0:1789708733.179868:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426301952 00000100:00100000:1.0:1789708733.179899:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426302080 00000100:00100000:1.0:1789708733.179902:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426302080 00000100:00100000:1.0:1789708733.179922:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789708733.179927:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426301952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708733.179964:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426301952:12345-0@lo:400:kworker.0 Request processed in 36us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708733.179971:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789708733.179984:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789708733.179991:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426302080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708733.180019:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426302080:12345-0@lo:400:kworker.0 Request processed in 29us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708733.180025:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789708733.180059:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426302080:0@lo:400:kworker.0 00000100:00100000:1.0:1789708733.180068:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426301952:0@lo:400:kworker.0 00000100:00080000:3.0:1789708733.180691:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789708733.750771:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1789708733.750789:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1789708733.750795:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1789708733.766587:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1789708733.766609:0:5841:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1789708733.766626:0:5841:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a143f905240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1789708733.766631:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a143464c100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a143f9053c0 00000020:00080000:3.0:1789708733.766635:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a143464c900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a143efba400 00000020:00080000:3.0:1789708733.766800:0:5841:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 6 batchid updated 00000004:00080000:3.0:1789708733.766809:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:1.0:1789708733.766958:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789708733.766994:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426302464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789708733.767068:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789708733.767326:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1789708733.767546:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1789708733.767626:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426302464 00000100:00100000:2.0:1789708733.767635:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426302464 00000100:00100000:0.0:1789708733.767952:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789708733.767962:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426302464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789708733.768267:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789708733.768271:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789708728 -> 1789708728 00002000:00010000:0.0:1789708733.768274:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1789708728 -> 1789708728 00002000:00010000:0.0:1789708733.768277:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789708728 -> 1789708728 00002000:00010000:0.0:1789708733.768279:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789708733.768371:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3287:x1876645426302464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 411us (1303us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789708733.768379:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789708733.768465:0:3287:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1789708733.768472:0:3287:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a143f4d9f80, transno 4294967321 00000004:00080000:1.0:1789708733.768516:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:1.0:1789708733.768550:0:3287:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a1308e27100 x1876645426302464/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789708749 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789708733.768563:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a1308e27100/2, rc 0, transno 4294967324 00000100:00100000:1.0:1789708733.769166:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426302464:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1789708733.884364:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708734.913620:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708735.930934:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708736.766077:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708736.766114:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708736.766139:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708736.766158:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708736.766181:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708736.766209:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415845760 00000100:00100000:0.0:1789708736.766220:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415845760 00000100:00100000:0.0:1789708736.766276:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415845888 00000100:00100000:0.0:1789708736.766279:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415845888 00000100:00100000:0.0:1789708736.766313:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:0.0:1789708736.766322:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2363:x1876645415845760:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708736.766393:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2363:x1876645415845760:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 72us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708736.766401:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:0.0:1789708736.766417:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:0.0:1789708736.766423:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2363:x1876645415845888:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708736.766446:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2363:x1876645415845888:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708736.766452:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:0.0:1789708736.766467:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415846016 00000100:00100000:0.0:1789708736.766471:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415846016 00000100:00100000:0.0:1789708736.766494:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415845632 00000100:00100000:0.0:1789708736.766496:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415845632 00000100:00100000:0.0:1789708736.766513:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 122 00000100:00100000:0.0:1789708736.766520:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c9d2a103-cf70-4470-bdd0-387470668318+5:2363:x1876645415846016:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708736.766544:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c9d2a103-cf70-4470-bdd0-387470668318+5:2363:x1876645415846016:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708736.766551:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 122 00000100:00100000:0.0:1789708736.766560:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 123 00000100:00100000:0.0:1789708736.766565:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+18:2363:x1876645415845632:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708736.766588:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+18:2363:x1876645415845632:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 22us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708736.766594:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 123 00000100:00080000:0.0:1789708736.766614:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789708736.766622:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789708736.766625:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708736.766987:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415845504 00000100:00100000:3.0:1789708736.766992:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415845504 00000100:00100000:3.0:1789708736.767029:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 281 00000100:00100000:3.0:1789708736.767036:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2363:x1876645415845504:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708736.767144:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2363:x1876645415845504:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 109us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708736.767152:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 281 00010000:00010000:3.0:1789708736.960207:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708737.787043:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426302592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708737.787130:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708737.787393:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426302592 00000100:00100000:3.0:1789708737.787400:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426302592 00000100:00100000:3.0:1789708737.787469:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789708737.787478:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308e27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426302592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789708737.787530:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708737.787633:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308e27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426302592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708737.787640:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1789708737.787724:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708737.787957:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426302592:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789708737.979516:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708737.989192:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708737.993825:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415846144 00000100:00100000:3.0:1789708737.993844:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415846144 00000100:00100000:3.0:1789708737.993932:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 236 00000100:00100000:3.0:1789708737.993943:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+18:11278:x1876645415846144:12345-192.168.202.53@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789708737.994070:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+18:11278:x1876645415846144:12345-192.168.202.53@tcp:60:lhsmtool_posix.0 Request processed in 129us (4889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708737.994813:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 236 00000100:00100000:1.0:1789708737.997611:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708737.997805:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415846400 00000100:00100000:2.0:1789708737.997829:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415846400 00000100:00100000:2.0:1789708737.997890:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 65 00000100:00100000:2.0:1789708737.997900:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+18:11278:x1876645415846400:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789708738.000073:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+19:11278:x1876645415846400:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 2162us (2459us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789708738.000160:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 65 00000100:00100000:1.0:1789708738.298968:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789708738.298994:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426302720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708738.299112:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426303104:0@lo:400:kworker.0 00000100:00100000:2.0:1789708738.299189:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708738.299191:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708738.299253:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426302976:0@lo:400:kworker.0 00000100:00100000:0.0:1789708738.299348:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426303232:0@lo:400:kworker.0 00000100:00100000:1.0:1789708738.316351:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426302848:0@lo:400:kworker.0 00000100:00100000:1.0:1789708738.316428:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708738.316471:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426303360:0@lo:400:kworker.0 00000100:00100000:1.0:1789708738.316501:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708738.316556:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426302848 00000100:00100000:1.0:1789708738.316565:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426302848 00000100:00100000:1.0:1789708738.316622:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789708738.316631:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426302848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708738.316695:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3289:x1876645426302848:12345-0@lo:400:kworker.0 Request processed in 64us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708738.316703:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789708738.316752:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426302720 00000100:00100000:1.0:1789708738.316756:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426302720 00000100:00100000:1.0:1789708738.316791:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789708738.316796:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1876645426302720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789708738.316823:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708738.316855:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1876645426302720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (17668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708738.316861:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1789708738.316881:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708738.316917:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426302848:0@lo:400:kworker.0 00000100:00100000:1.0:1789708738.316953:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426302720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708738.319392:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426303104 00000100:00100000:1.0:1789708738.319408:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426303104 00000100:00100000:3.0:1789708738.319409:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708738.319464:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426303488:0@lo:400:kworker.0 00000100:00100000:1.0:1789708738.319473:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426303360 00000100:00100000:1.0:1789708738.319478:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426303360 00000100:00100000:3.0:1789708738.319509:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708738.319509:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426302976 00000100:00100000:1.0:1789708738.319514:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426302976 00000100:00100000:1.0:1789708738.319537:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789708738.319547:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426303104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708738.319572:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789708738.319582:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426303360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708738.319626:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426303104:12345-0@lo:400:kworker.0 Request processed in 65us (20424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708738.319635:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789708738.319645:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426303360:12345-0@lo:400:kworker.0 Request processed in 64us (3141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708738.319669:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789708738.319679:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789708738.319688:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426302976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708738.319693:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426303488 00000100:00100000:3.0:1789708738.319698:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426303488 00000100:00100000:3.0:1789708738.319735:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789708738.319736:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426302976:12345-0@lo:400:kworker.0 Request processed in 48us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708738.319745:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1876645426303488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708738.319747:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1789708738.319783:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708738.319784:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1876645426303488:12345-0@lo:400:kworker.0 Request processed in 39us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708738.319798:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789708738.319979:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426302976:0@lo:400:kworker.0 00000100:00100000:1.0:1789708738.322913:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426303360:0@lo:400:kworker.0 00000100:00100000:0.0:1789708738.328230:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708738.329429:0:11993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426303232 00000100:00100000:1.0:1789708738.329443:0:11993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426303232 00000100:00100000:1.0:1789708738.329518:0:11993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789708738.329530:0:11993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426303232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708738.329634:0:11993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426303232:12345-0@lo:400:kworker.0 Request processed in 106us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708738.329641:0:11993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789708738.334935:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426303232:0@lo:400:kworker.0 00000100:00100000:3.0:1789708738.335308:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426303488:0@lo:400:kworker.0 00000100:00100000:2.0:1789708738.335632:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426303104:0@lo:400:kworker.0 00000020:00080000:3.0:1789708738.900925:0:5841:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1789708738.901372:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1789708738.901449:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789708738.901465:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:3.0:1789708738.909811:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:2.0:1789708739.003019:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789708739.964108:0:11657:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789708739.964119:0:11657:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708739.964489:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:1.0:1789708739.964501:0:11657:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789708740.027997:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789708740.188232:0:12739:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:18:58 (1789708738) 00010000:00010000:3.0:1789708741.051675:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708741.887058:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708741.887117:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708741.887151:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708741.887178:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708741.887355:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415846528 00000100:00100000:1.0:1789708741.887367:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415846528 00000100:00100000:1.0:1789708741.887423:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 283 00000100:00100000:1.0:1789708741.887432:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2364:x1876645415846528:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708741.887510:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2364:x1876645415846528:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 78us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708741.887530:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 283 00000100:00100000:0.0:1789708741.887843:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415846784 00000100:00100000:0.0:1789708741.887849:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415846784 00000100:00100000:0.0:1789708741.887894:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:0.0:1789708741.887902:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2364:x1876645415846784:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708741.887940:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2364:x1876645415846784:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 39us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708741.887947:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:1.0:1789708741.888039:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415846656 00000100:00100000:1.0:1789708741.888043:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415846656 00000100:00100000:1.0:1789708741.888085:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415847040 00000100:00100000:1.0:1789708741.888088:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415847040 00000100:00100000:1.0:1789708741.888110:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 127 00000100:00100000:1.0:1789708741.888116:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+18:2363:x1876645415846656:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708741.888154:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14bb7f14-3461-47f6-86c9-db3f545050ad+18:2363:x1876645415846656:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 38us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708741.888170:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 127 00000100:00100000:1.0:1789708741.888183:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 128 00000100:00100000:1.0:1789708741.888304:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c9d2a103-cf70-4470-bdd0-387470668318+5:2364:x1876645415847040:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708741.888329:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c9d2a103-cf70-4470-bdd0-387470668318+5:2364:x1876645415847040:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 28us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708741.888335:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 128 00000100:00080000:1.0:1789708741.888351:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789708741.888356:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708741.893991:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708741.894731:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415846912 00000100:00100000:3.0:1789708741.894743:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415846912 00000100:00100000:3.0:1789708741.894944:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:3.0:1789708741.894957:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2363:x1876645415846912:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708741.895051:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2363:x1876645415846912:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 87us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708741.895060:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00080000:1.0:1789708741.902275:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789708742.085846:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708742.364770:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708742.364918:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415847168 00000100:00100000:3.0:1789708742.364929:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415847168 00000100:00100000:3.0:1789708742.364991:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 237 00000100:00100000:3.0:1789708742.365000:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c9d2a103-cf70-4470-bdd0-387470668318+5:12289:x1876645415847168:12345-192.168.202.53@tcp:101:lsof.0 00010000:00010000:3.0:1789708742.365018:0:11601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708742.365048:0:11601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68670be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4bb9 expref: -99 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708742.365123:0:11601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c68670c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708742.365156:0:11601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c68670c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708742.365170:0:11601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c68670c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708742.365218:0:11601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789708742.365222:0:11601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789708742.365261:0:11601:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c68670c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708742.365287:0:11601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39e00/0xa8f741d1c68670be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4bb9 expref: 7 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708742.365305:0:11601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c68670c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4bb9 expref: 6 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708742.365314:0:11601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:3.0:1789708742.365318:0:11601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789708742.365322:0:11601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38600, rc 0) 00000100:00100000:3.0:1789708742.365383:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c9d2a103-cf70-4470-bdd0-387470668318+6:12289:x1876645415847168:12345-192.168.202.53@tcp:101:lsof.0 Request processed in 384us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708742.365391:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 237 00000100:00100000:0.0:1789708742.909625:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789708742.909699:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426303616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708742.909792:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708742.910107:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426303616 00000100:00100000:3.0:1789708742.910117:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426303616 00000100:00080000:1.0:1789708742.910343:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708742.912559:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789708742.912599:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426303616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789708742.912669:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708742.912795:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426303616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 211us (3002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708742.912804:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789708742.912918:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426303616:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789708743.098976:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708743.418991:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789708743.419015:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426303744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708743.419106:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708743.419545:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426303744 00000100:00100000:2.0:1789708743.419554:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426303744 00000100:00100000:2.0:1789708743.419668:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789708743.419680:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308e26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426303744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789708743.419722:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789708743.419778:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308e26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426303744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708743.419785:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1789708743.419806:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708743.419835:0:3289:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1789708743.419840:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a1308e27100, transno 4294967324 00000100:00100000:2.0:1789708743.419857:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426303744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708743.422949:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426304128:0@lo:400:kworker.0 00000100:00100000:1.0:1789708743.423033:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708743.423085:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789708743.423092:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876645426304000:0@lo:400:kworker.0 00000100:00100000:1.0:1789708743.423115:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708743.423150:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426304128 00000100:00100000:1.0:1789708743.423160:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426304128 00000100:00100000:1.0:1789708743.423227:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426304000 00000100:00100000:1.0:1789708743.423230:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426304000 00000100:00100000:1.0:1789708743.423252:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789708743.423260:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426304128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708743.423730:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426304128:12345-0@lo:400:kworker.0 Request processed in 469us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708743.423739:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789708743.423758:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789708743.423766:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876645426304000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708743.423797:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876645426304000:12345-0@lo:400:kworker.0 Request processed in 32us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708743.423803:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789708743.423833:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426304256:0@lo:400:kworker.0 00000100:00100000:1.0:1789708743.423863:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708743.423884:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789708743.423890:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426303872:0@lo:400:kworker.0 00000100:00100000:1.0:1789708743.423916:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708743.423941:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876645426304384:0@lo:400:kworker.0 00000100:00100000:1.0:1789708743.423963:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708743.423988:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426303872 00000100:00100000:1.0:1789708743.423992:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426303872 00000100:00100000:1.0:1789708743.424019:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789708743.424033:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3288:x1876645426303872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708743.424067:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3288:x1876645426303872:12345-0@lo:400:kworker.0 Request processed in 42us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708743.424073:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789708743.424100:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426304384 00000100:00100000:1.0:1789708743.424104:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426304384 00000100:00100000:1.0:1789708743.424129:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789708743.424136:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876645426304384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708743.424174:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876645426304384:12345-0@lo:400:kworker.0 Request processed in 38us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708743.424418:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1789708743.424437:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708743.424591:0:10424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426304256 00000100:00100000:0.0:1789708743.424596:0:10424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426304256 00000100:00100000:0.0:1789708743.424632:0:10424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789708743.424640:0:10424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308e27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426304256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708743.424706:0:10424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308e27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426304256:12345-0@lo:400:kworker.0 Request processed in 67us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708743.424713:0:10424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789708743.424777:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876645426304000:0@lo:400:kworker.0 00000100:00100000:0.0:1789708743.424791:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426304128:0@lo:400:kworker.0 00000100:00100000:1.0:1789708743.424883:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426303872:0@lo:400:kworker.0 00000100:00100000:1.0:1789708743.424899:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876645426304384:0@lo:400:kworker.0 00000100:00100000:1.0:1789708743.424909:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426304256:0@lo:400:kworker.0 00000100:00100000:0.0:1789708744.041044:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708744.043134:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415847424 00000100:00100000:1.0:1789708744.043149:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415847424 00000100:00100000:1.0:1789708744.043248:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00100000:1.0:1789708744.043260:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+18:12290:x1876645415847424:12345-192.168.202.53@tcp:35:umount.0 00000100:00100000:1.0:1789708744.043688:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+19:12290:x1876645415847424:12345-192.168.202.53@tcp:35:umount.0 Request processed in 429us (2653us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1789708744.043697:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00080000:2.0:1789708744.044121:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708744.050073:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708744.050328:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415847680 00000100:00100000:1.0:1789708744.050339:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415847680 00000100:00100000:1.0:1789708744.050397:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 67 00000100:00100000:1.0:1789708744.050407:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+19:12290:x1876645415847680:12345-192.168.202.53@tcp:35:umount.0 00000100:00100000:2.0:1789708744.057331:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+20:12290:x1876645415847680:12345-192.168.202.53@tcp:35:umount.0 Request processed in 6915us (7258us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789708744.057345:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 67 00000100:00100000:3.0:1789708744.061285:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708744.061394:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415847936 00000100:00100000:0.0:1789708744.061405:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415847936 00000100:00100000:0.0:1789708744.061465:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 68 00000100:00100000:0.0:1789708744.061476:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14069fa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+20:12290:x1876645415847936:12345-192.168.202.53@tcp:35:umount.0 00000100:00100000:0.0:1789708744.061766:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14069fa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14bb7f14-3461-47f6-86c9-db3f545050ad+21:12290:x1876645415847936:12345-192.168.202.53@tcp:35:umount.0 Request processed in 291us (490us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789708744.061775:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 68 00000100:00100000:0.0:1789708744.064104:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708744.064207:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415848192 00000100:00100000:2.0:1789708744.064229:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415848192 00000100:00100000:2.0:1789708744.064291:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:2.0:1789708744.064301:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+21:12290:x1876645415848192:12345-192.168.202.53@tcp:35:umount.0 00000100:00100000:2.0:1789708744.065757:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14bb7f14-3461-47f6-86c9-db3f545050ad+22:12290:x1876645415848192:12345-192.168.202.53@tcp:35:umount.0 Request processed in 1449us (1654us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1789708744.065770:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:2.0:1789708744.086347:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708744.086387:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708744.086415:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708744.086479:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708744.086509:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415848704 00000100:00100000:2.0:1789708744.086519:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415848704 00000100:00100000:2.0:1789708744.086581:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415848960 00000100:00100000:2.0:1789708744.086585:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415848960 00000100:00100000:2.0:1789708744.086597:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415848832 00000100:00100000:2.0:1789708744.086599:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415848832 00000100:00100000:2.0:1789708744.086614:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:2.0:1789708744.086622:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7afaea2d-d635-45b7-851c-2e40ec565b3d+15:2361:x1876645415848704:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708744.086637:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708744.086674:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa39000/0xa8f741d1c686614b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d474b expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708744.086690:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708744.086754:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7afaea2d-d635-45b7-851c-2e40ec565b3d+14:2361:x1876645415848704:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 132us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708744.086762:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:2.0:1789708744.086778:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:2.0:1789708744.086784:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7afaea2d-d635-45b7-851c-2e40ec565b3d+13:2361:x1876645415848960:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708744.086815:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708744.086824:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a14014a8000/0xa8f741d1c686632e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4816 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708744.086833:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708744.086849:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7afaea2d-d635-45b7-851c-2e40ec565b3d+12:2361:x1876645415848960:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 65us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708744.086854:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:2.0:1789708744.086866:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:2.0:1789708744.086871:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1407f55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7afaea2d-d635-45b7-851c-2e40ec565b3d+11:2361:x1876645415848832:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708744.086878:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708744.086886:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400030e00/0xa8f741d1c68660b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4713 expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708744.086894:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708744.086907:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1407f55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2361:x1876645415848832:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 36us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708744.086913:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:2.0:1789708744.086956:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415848576 00000100:00100000:2.0:1789708744.086960:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415848576 00000100:00100000:2.0:1789708744.086995:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 72 00000100:00100000:2.0:1789708744.087001:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2360:x1876645415848576:12345-192.168.202.53@tcp:9:umount.0 00000020:00000080:2.0:1789708744.087026:0:6673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c686668b 00000020:00010000:2.0:1789708744.087033:0:6673:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a14059d2800: total 0 00000100:00080000:2.0:1789708744.087037:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8a13069bd800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1789708744.087060:0:5807:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a14059d2800: total 0 00000001:00000004:2.0:1789708744.087071:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:1.0:1789708744.087095:0:5807:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a14059d2800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789708744.087137:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e037ac67/0xa8f741d1c6866a27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49eb expref: 6 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708744.087165:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000988150dc/0xa8f741d1c68670b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4bb2 expref: 5 pid: 10424 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708744.087186:0:5807:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a14059d2800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789708744.087198:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708744.087200:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708744.087202:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708744.087305:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+2:2360:x1876645415848576:12345-192.168.202.53@tcp:9:umount.0 Request processed in 303us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708744.087317:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 72 00000100:00080000:2.0:1789708744.087341:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708744.107337:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708744.107446:0:11993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415849088 00000100:00100000:0.0:1789708744.107456:0:11993:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415849088 00000100:00100000:0.0:1789708744.107538:0:11993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 73 00000100:00100000:0.0:1789708744.107548:0:11993:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+5:2360:x1876645415849088:12345-192.168.202.53@tcp:9:umount.0 00000020:00000080:0.0:1789708744.107595:0:11993:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6866423 00000100:00080000:0.0:1789708744.107621:0:11993:0:(import.c:65:import_set_state_nolock()) ffff8a1434bfe800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789708744.107704:0:11993:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1789708744.107990:0:11993:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:14bb7f14-3461-47f6-86c9-db3f545050ad+2:2360:x1876645415849088:12345-192.168.202.53@tcp:9:umount.0 Request processed in 442us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708744.107999:0:11993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 73 00010000:00010000:3.0:1789708744.108115:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789708744.108635:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789708744.122929:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708744.138523:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708744.138689:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415850112 00000100:00100000:3.0:1789708744.138702:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415850112 00000100:00100000:3.0:1789708744.138764:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 238 00000100:00100000:3.0:1789708744.138774:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+22:2360:x1876645415850112:12345-192.168.202.53@tcp:39:umount.0 00000020:00000080:3.0:1789708744.138816:0:5821:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c68660bf 00000020:00010000:3.0:1789708744.138834:0:5821:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a1403188000: total 0 00000100:00080000:3.0:1789708744.138839:0:5821:0:(import.c:65:import_set_state_nolock()) ffff8a14076be000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789708744.138873:0:5821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:2.0:1789708744.139167:0:8433:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a1403188000: total 0 00010000:00010000:2.0:1789708744.139213:0:8433:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a1403188000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789708744.139246:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:2.0:1789708744.139250:0:8433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789708744.139257:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23400/0xa8f741d1c6866a12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49e4 expref: 21 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708744.139279:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:2.0:1789708744.139282:0:8433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708744.139286:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14013a1c00/0xa8f741d1c6866a7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a00 expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708744.139298:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:2.0:1789708744.139301:0:8433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789708744.139304:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68666e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4912 expref: 19 pid: 7140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708744.139317:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1414c38a00) 00010000:00010000:2.0:1789708744.139319:0:8433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708744.139323:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ae00/0xa8f741d1c6866389 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4824 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708744.139342:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:2.0:1789708744.139358:0:8433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789708744.139364:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22000/0xa8f741d1c6866908 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d499e expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708744.139379:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:2.0:1789708744.139382:0:8433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708744.139385:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c6867078 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b9d expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708744.139397:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a1414c38f00) 00010000:00010000:2.0:1789708744.139400:0:8433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789708744.139403:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68663f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4840 expref: 15 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708744.139416:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:2.0:1789708744.139419:0:8433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789708744.139423:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d23a00/0xa8f741d1c68670a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4bab expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708744.139434:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1411b4a700) 00010000:00010000:2.0:1789708744.139436:0:8433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708744.139440:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38000/0xa8f741d1c68663a5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d482b expref: 13 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708744.139455:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:2.0:1789708744.139458:0:8433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789708744.139461:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c6866d76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ad9 expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708744.139488:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a1414c38100) 00010000:00010000:2.0:1789708744.139491:0:8433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789708744.139495:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa39c00/0xa8f741d1c6866f98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4b65 expref: 11 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708744.139511:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a1414c38600) 00010000:00010000:2.0:1789708744.139514:0:8433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789708744.139518:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6866a97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4a07 expref: 10 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708744.139532:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a1414c38d00) 00010000:00010000:2.0:1789708744.139535:0:8433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708744.139538:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1426d22200/0xa8f741d1c68669e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d49d6 expref: 9 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708744.139550:0:8433:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a1403188000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1789708744.139573:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708744.139575:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708744.139577:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708744.140233:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14bb7f14-3461-47f6-86c9-db3f545050ad+7:2360:x1876645415850112:12345-192.168.202.53@tcp:39:umount.0 Request processed in 1457us (1716us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789708744.140244:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 238 00010000:00010000:1.0:1789708745.146847:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708746.172108:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708747.015347:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708747.015402:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708747.015490:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415850240 00000100:00100000:2.0:1789708747.015500:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415850240 00000100:00100000:2.0:1789708747.015568:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 285 00000100:00100000:2.0:1789708747.015579:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2362:x1876645415850240:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708747.015618:0:11601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415850368 00000100:00100000:3.0:1789708747.015622:0:11601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415850368 00000100:00100000:3.0:1789708747.015712:0:11601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 132 00000100:00100000:2.0:1789708747.015713:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2362:x1876645415850240:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 136us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708747.015721:0:11601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1308e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c9d2a103-cf70-4470-bdd0-387470668318+6:2361:x1876645415850368:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708747.015721:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 285 00000100:00100000:3.0:1789708747.015755:0:11601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1308e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c9d2a103-cf70-4470-bdd0-387470668318+6:2361:x1876645415850368:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 37us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708747.015761:0:11601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 132 00000100:00080000:0.0:1789708747.015983:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708747.023112:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708747.023161:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708747.023283:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415850624 00000100:00100000:3.0:1789708747.023293:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415850624 00000100:00100000:3.0:1789708747.023376:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415850496 00000100:00100000:3.0:1789708747.023380:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415850496 00000100:00100000:3.0:1789708747.023426:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:3.0:1789708747.023436:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7afaea2d-d635-45b7-851c-2e40ec565b3d+11:2361:x1876645415850624:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708747.023463:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708747.023483:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400031400/0xa8f741d1c6866198 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d478a expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708747.023502:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708747.023645:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:1.0:1789708747.023684:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7afaea2d-d635-45b7-851c-2e40ec565b3d+10:2361:x1876645415850496:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708747.023706:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708747.023717:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400031600/0xa8f741d1c6866191 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4760 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708747.023727:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708747.023946:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:2361:x1876645415850624:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 510us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708747.023954:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:3.0:1789708747.024544:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708747.024620:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415850752 00000100:00100000:0.0:1789708747.024627:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415850752 00000100:00100000:0.0:1789708747.024714:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:0.0:1789708747.024734:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7afaea2d-d635-45b7-851c-2e40ec565b3d+9:2362:x1876645415850752:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708747.024746:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708747.024759:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a14014a8200/0xa8f741d1c6866327 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d480f expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708747.024777:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708747.024808:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7afaea2d-d635-45b7-851c-2e40ec565b3d+8:2362:x1876645415850752:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 86us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708747.025030:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:1.0:1789708747.030085:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7afaea2d-d635-45b7-851c-2e40ec565b3d+7:2361:x1876645415850496:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 6392us (6910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708747.030101:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:3.0:1789708747.042923:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708747.043120:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415851008 00000100:00100000:0.0:1789708747.043131:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415851008 00000100:00100000:1.0:1789708747.043285:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 239 00000100:00100000:1.0:1789708747.043298:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c9d2a103-cf70-4470-bdd0-387470668318+6:2360:x1876645415851008:12345-192.168.202.53@tcp:39:umount.0 00000020:00000080:1.0:1789708747.043340:0:5820:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c68661a6 00000020:00010000:1.0:1789708747.043350:0:5820:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a143ed01000: total 0 00000100:00080000:1.0:1789708747.043354:0:5820:0:(import.c:65:import_set_state_nolock()) ffff8a143ed03800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789708747.043396:0:5820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1789708747.043642:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c9d2a103-cf70-4470-bdd0-387470668318+5:2360:x1876645415851008:12345-192.168.202.53@tcp:39:umount.0 Request processed in 346us (728us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1789708747.043810:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 239 00000020:00010000:2.0:1789708747.044597:0:5808:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a143ed01000: total 0 00010000:00010000:2.0:1789708747.044663:0:5808:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a143ed01000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789708747.044704:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:2.0:1789708747.044708:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708747.044717:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143fa38600/0xa8f741d1c68670c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4bb9 expref: 4 pid: 11601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708747.044741:0:5808:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a143ed01000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789708747.044752:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708747.044754:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708747.044756:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708747.083939:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708747.085864:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415851264 00000100:00100000:1.0:1789708747.085878:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415851264 00000100:00100000:1.0:1789708747.086297:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 286 00000100:00100000:1.0:1789708747.086308:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1402fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+7:2360:x1876645415851264:12345-192.168.202.53@tcp:251:umount.0 00000020:00000080:1.0:1789708747.086357:0:5812:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c686609c 00000020:00010000:1.0:1789708747.086365:0:5812:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a143f2e1800: total 0 00000100:00080000:1.0:1789708747.086382:0:5812:0:(import.c:65:import_set_state_nolock()) ffff8a143f2e7800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1789708747.086556:0:8433:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a143f2e1800: total 0 00010000:00010000:3.0:1789708747.086562:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708747.086621:0:8433:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a143f2e1800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789708747.086672:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1403b6b400/0xa8f741d1c6866152 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4752 expref: 3 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708747.086693:0:8433:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a143f2e1800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789708747.086705:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708747.086707:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708747.086709:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708747.086858:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1402fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7afaea2d-d635-45b7-851c-2e40ec565b3d+1:2360:x1876645415851264:12345-192.168.202.53@tcp:251:umount.0 Request processed in 550us (2927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708747.086867:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 286 00000020:00000080:1.0:1789708747.086877:0:5812:0:(genops.c:885:class_export_put()) final put ffff8a143f2e1800/7afaea2d-d635-45b7-851c-2e40ec565b3d 00000020:00000080:0.0:1789708747.087819:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a143f2e1800/7afaea2d-d635-45b7-851c-2e40ec565b3d for MGS 00000020:00000080:0.0:1789708747.087868:0:485:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a143f2e7800 for MGS 00010000:00010000:1.0:1789708747.195062:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708748.030562:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789708748.030589:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426304512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708748.030694:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708748.038697:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426304512 00000100:00100000:2.0:1789708748.038713:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426304512 00000100:00100000:2.0:1789708748.038802:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789708748.038816:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426304512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789708748.038859:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789708748.038952:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426304512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (8259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708748.038960:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789708748.039024:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426304512:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789708748.041608:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789708748.220386:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708748.540297:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426305024:0@lo:400:kworker.0 00000100:00100000:1.0:1789708748.540380:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708748.540442:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789708748.540449:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426304640:0@lo:400:kworker.0 00000100:00100000:1.0:1789708748.540479:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708748.540509:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876645426305152:0@lo:400:kworker.0 00000100:00100000:1.0:1789708748.540547:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708748.540573:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426304768:0@lo:400:kworker.0 00000100:00100000:1.0:1789708748.540596:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708748.540611:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426305280:0@lo:400:kworker.0 00000100:00100000:1.0:1789708748.540630:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708748.540647:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789708748.540682:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1308e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426304896:0@lo:400:kworker.0 00000100:00100000:1.0:1789708748.540705:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708748.540737:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426305152 00000100:00100000:1.0:1789708748.540757:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426305152 00000100:00100000:1.0:1789708748.540806:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426304768 00000100:00100000:1.0:1789708748.540809:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426304768 00000100:00100000:2.0:1789708748.540917:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426304640 00000100:00100000:2.0:1789708748.540922:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426304640 00000100:00100000:2.0:1789708748.540955:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789708748.540965:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14036e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3286:x1876645426304640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708748.541025:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14036e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3286:x1876645426304640:12345-0@lo:400:kworker.0 Request processed in 61us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708748.541038:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789708748.541062:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426304896 00000100:00100000:1.0:1789708748.541067:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426304896 00000100:00100000:2.0:1789708748.541080:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426305024 00000100:00100000:2.0:1789708748.541086:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426305024 00000100:00100000:1.0:1789708748.541094:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789708748.541104:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876645426305152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708748.541114:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426305280 00000100:00100000:2.0:1789708748.541119:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426305280 00000100:00100000:2.0:1789708748.541150:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789708748.541150:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876645426305152:12345-0@lo:400:kworker.0 Request processed in 47us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708748.541164:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789708748.541166:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426305024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708748.541182:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789708748.541191:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426304768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708748.541208:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426305024:12345-0@lo:400:kworker.0 Request processed in 46us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708748.541216:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789708748.541232:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789708748.541238:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426304768:12345-0@lo:400:kworker.0 Request processed in 48us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708748.541244:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426305280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708748.541249:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789708748.541265:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789708748.541274:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426304896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708748.541290:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426305280:12345-0@lo:400:kworker.0 Request processed in 50us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708748.541298:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789708748.541324:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426304896:12345-0@lo:400:kworker.0 Request processed in 52us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708748.541331:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789708748.541374:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426304640:0@lo:400:kworker.0 00000100:00080000:3.0:1789708748.541616:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789708748.541621:0:5815:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708748.543358:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426304896:0@lo:400:kworker.0 00000100:00100000:1.0:1789708748.543379:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426304768:0@lo:400:kworker.0 00000100:00100000:1.0:1789708748.543389:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426305280:0@lo:400:kworker.0 00000100:00100000:1.0:1789708748.543435:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789708748.543445:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426305408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789708748.543503:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708748.543648:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876645426305152:0@lo:400:kworker.0 00000100:00100000:2.0:1789708748.543685:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1308e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426305024:0@lo:400:kworker.0 00000100:00100000:3.0:1789708748.544082:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426305408 00000100:00100000:3.0:1789708748.544098:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426305408 00000100:00100000:3.0:1789708748.544155:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789708748.544166:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426305408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789708748.544204:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708748.544264:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426305408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708748.544272:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789708748.544620:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426305408:0@lo:13:osp-pre-1-0.0 00000020:01000004:2.0:1789708749.048569:0:12937:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789708749.085787:0:12937:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789708749.085838:0:12937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a800/0xa8f741d1c6866121 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866128 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708749.085854:0:12937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a800/0xa8f741d1c6866121 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6866128 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708749.085862:0:12937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a800/0xa8f741d1c6866121 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c6866128 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708749.085869:0:12937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a800/0xa8f741d1c6866121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c6866128 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708749.085887:0:12937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789708749.085892:0:12937:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1789708749.087072:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708749.087083:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a800/0xa8f741d1c6866121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c6866128 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.087094:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a800 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:0.0:1789708749.087098:0:5808:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a800/0xa8f741d1c6866121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c6866128 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.087118:0:5808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a800/0xa8f741d1c6866121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa8f741d1c6866128 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708749.087126:0:5808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a800/0xa8f741d1c6866121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa8f741d1c6866128 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708749.087133:0:5808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789708749.087135:0:5808:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789708749.087138:0:5808:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789708749.087178:0:5808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a800/0xa8f741d1c6866121 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa8f741d1c6866128 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.087184:0:5808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708749.087222:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a800/0xa8f741d1c6866121 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa8f741d1c6866128 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.087230:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a800/0xa8f741d1c6866121 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa8f741d1c6866128 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.087243:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708749.087245:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708749.087246:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708749.087319:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789708749.087338:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426305536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789708749.087404:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708749.087741:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426305536 00000100:00100000:0.0:1789708749.087749:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426305536 00000100:00100000:0.0:1789708749.087796:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789708749.087806:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3287:x1876645426305536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708749.087827:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708749.087844:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6866128 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa8f741d1c6866121 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.087869:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708749.087909:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:3287:x1876645426305536:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708749.087916:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789708749.088465:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426305536:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789708749.092756:0:12937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789708749.092764:0:12937:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789708749.092771:0:12937:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789708749.092942:0:12937:0:(import.c:65:import_set_state_nolock()) ffff8a1440ccf800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789708749.093029:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876645426305664:0@lo:39:umount.0 00000100:00100000:3.0:1789708749.093103:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708749.096722:0:7140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426305664 00000100:00100000:0.0:1789708749.096739:0:7140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426305664 00000100:00100000:0.0:1789708749.097063:0:7140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789708749.097077:0:7140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876645426305664:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789708749.097111:0:7140:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865eab 00000100:00080000:0.0:1789708749.097120:0:7140:0:(import.c:65:import_set_state_nolock()) ffff8a14030e9800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789708749.097288:0:7140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3285:x1876645426305664:12345-0@lo:39:umount.0 Request processed in 215us (4184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708749.097296:0:7140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000020:00000080:0.0:1789708749.097307:0:7140:0:(genops.c:885:class_export_put()) final put ffff8a14030ec000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1789708749.097335:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789708749.097348:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a14030ec000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789708749.097397:0:485:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a14030e9800 for lustre-MDT0000 00000100:00080000:0.0:1789708749.097547:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a1440ccf800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789708749.097562:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876645426305664:0@lo:39:umount.0 00000100:00080000:0.0:1789708749.097596:0:12937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789708749.097600:0:12937:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789708749.097605:0:12937:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789708749.099150:0:12937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa39400/0xa8f741d1c686612f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866136 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.099237:0:12937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa39400/0xa8f741d1c686612f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6866136 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.099247:0:12937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa39400/0xa8f741d1c686612f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c6866136 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.099253:0:12937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a143fa39400/0xa8f741d1c686612f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c6866136 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.099272:0:12937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708749.099278:0:12937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa39a00/0xa8f741d1c6866056 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686605d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.099285:0:12937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa39a00/0xa8f741d1c6866056 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c686605d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.099292:0:12937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa39a00/0xa8f741d1c6866056 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c686605d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.099298:0:12937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a143fa39a00/0xa8f741d1c6866056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c686605d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.099311:0:12937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789708749.099319:0:12937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143efc4e00/0xa8f741d1c6866351 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6866358 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.099325:0:12937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143efc4e00/0xa8f741d1c6866351 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6866358 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.099340:0:12937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143efc4e00/0xa8f741d1c6866351 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c6866358 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.099347:0:12937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a143efc4e00/0xa8f741d1c6866351 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c6866358 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.099359:0:12937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789708749.099364:0:12937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400031c00/0xa8f741d1c6865e0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6865e11 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.099370:0:12937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400031c00/0xa8f741d1c6865e0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6865e11 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.099375:0:12937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400031c00/0xa8f741d1c6865e0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c6865e11 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.099381:0:12937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1400031c00/0xa8f741d1c6865e0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c6865e11 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.099392:0:12937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1789708749.099395:0:12937:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1789708749.099422:0:12937:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789708749.099427:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789708749.099432:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789708749.099437:0:12937:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1789708749.099444:0:12937:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a1306ed4800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789708749.099524:0:12937:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a1406a53000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789708749.099533:0:12937:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8a143ed01000 c9d2a103-cf70-4470-bdd0-387470668318 192.168.202.53@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789708749.099544:0:12937:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8a1403188000 14bb7f14-3461-47f6-86c9-db3f545050ad 192.168.202.53@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:0.0:1789708749.099550:0:12937:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8a1403100000) has exports, disconnecting them 00000020:00080000:0.0:1789708749.099555:0:12937:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a1306ed4800), last request at 1789708748 00000020:00000080:0.0:1789708749.099561:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c686601e 00000100:00080000:0.0:1789708749.099580:0:12937:0:(import.c:65:import_set_state_nolock()) ffff8a1306ed5800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789708749.099597:0:12937:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1306ed4800): rc 0 00000020:00000080:0.0:1789708749.099600:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a1306ed4800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1789708749.099610:0:12937:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a1406a53000), last request at 1789708748 00000020:00000080:0.0:1789708749.099612:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865f53 00000100:00080000:0.0:1789708749.099617:0:12937:0:(import.c:65:import_set_state_nolock()) ffff8a1406a52000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789708749.099623:0:12937:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1406a53000): rc 0 00000020:00000080:0.0:1789708749.099624:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a1406a53000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1789708749.099632:0:12937:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa44907c67ad8 00000100:00080000:0.0:1789708749.099677:0:12937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789708749.099681:0:12937:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1789708749.099694:0:12937:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789708749.099751:0:12937:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789708749.099774:0:12937:0:(import.c:65:import_set_state_nolock()) ffff8a1410964800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789708749.099790:0:12937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789708749.099793:0:12937:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1789708749.099930:0:12937:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789708749.100069:0:12937:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789708749.100081:0:12937:0:(import.c:65:import_set_state_nolock()) ffff8a14345ee000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789708749.100126:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8a1403100000) has no exports 00010000:00010000:0.0:1789708749.100240:0:8434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789708749.100247:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a143fa39400/0xa8f741d1c686612f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c6866136 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100267:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39400 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:0.0:1789708749.100271:0:8434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa39400/0xa8f741d1c686612f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c6866136 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100281:0:8434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a143fa39400/0xa8f741d1c686612f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa8f741d1c6866136 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708749.100288:0:8434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa39400/0xa8f741d1c686612f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa8f741d1c6866136 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708749.100294:0:8434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789708749.100297:0:8434:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1789708749.100299:0:8434:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1789708749.100324:0:8434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a143fa39400/0xa8f741d1c686612f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa8f741d1c6866136 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100331:0:8434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708749.100350:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a143fa39400/0xa8f741d1c686612f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa8f741d1c6866136 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100357:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a143fa39400/0xa8f741d1c686612f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa8f741d1c6866136 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100371:0:8434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789708749.100375:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a143fa39a00/0xa8f741d1c6866056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c686605d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100381:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39a00 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:0.0:1789708749.100384:0:8434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa39a00/0xa8f741d1c6866056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c686605d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100397:0:8434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a143fa39a00/0xa8f741d1c6866056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa8f741d1c686605d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708749.100404:0:8434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa39a00/0xa8f741d1c6866056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa8f741d1c686605d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708749.100409:0:8434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789708749.100411:0:8434:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789708749.100414:0:8434:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789708749.100430:0:8434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a143fa39a00/0xa8f741d1c6866056 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa8f741d1c686605d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100435:0:8434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708749.100554:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a143fa39a00/0xa8f741d1c6866056 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa8f741d1c686605d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100562:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a143fa39a00/0xa8f741d1c6866056 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa8f741d1c686605d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100578:0:8434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708749.100582:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a143efc4e00/0xa8f741d1c6866351 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c6866358 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100588:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4e00 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:0.0:1789708749.100591:0:8434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a143efc4e00/0xa8f741d1c6866351 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c6866358 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100597:0:8434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a143efc4e00/0xa8f741d1c6866351 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa8f741d1c6866358 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708749.100614:0:8434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a143efc4e00/0xa8f741d1c6866351 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa8f741d1c6866358 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708749.100620:0:8434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789708749.100622:0:8434:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789708749.100624:0:8434:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789708749.100641:0:8434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a143efc4e00/0xa8f741d1c6866351 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa8f741d1c6866358 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100647:0:8434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708749.100684:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a143efc4e00/0xa8f741d1c6866351 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa8f741d1c6866358 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100691:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a143efc4e00/0xa8f741d1c6866351 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa8f741d1c6866358 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100705:0:8434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708749.100709:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1400031c00/0xa8f741d1c6865e0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c6865e11 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100715:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400031c00 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:0.0:1789708749.100718:0:8434:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1400031c00/0xa8f741d1c6865e0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c6865e11 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100725:0:8434:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1400031c00/0xa8f741d1c6865e0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa8f741d1c6865e11 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708749.100732:0:8434:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1400031c00/0xa8f741d1c6865e0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa8f741d1c6865e11 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708749.100747:0:8434:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789708749.100749:0:8434:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789708749.100751:0:8434:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789708749.100764:0:8434:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1400031c00/0xa8f741d1c6865e0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa8f741d1c6865e11 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100770:0:8434:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708749.100776:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1400031c00/0xa8f741d1c6865e0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa8f741d1c6865e11 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.100781:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1400031c00/0xa8f741d1c6865e0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa8f741d1c6865e11 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708749.100918:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426306048:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708749.100945:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708749.100947:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708749.100949:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708749.100957:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708749.100994:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789708749.101116:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1306ed4800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789708749.101225:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1406a53000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1789708749.101247:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426306432:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789708749.101254:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a1306ed5800 for lustre-MDT0000 00000020:00000080:0.0:1789708749.101261:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a1406a52000 for lustre-MDT0000 00010000:00010000:0.0:1789708749.101272:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708749.101274:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708749.101285:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426305792:0@lo:9:umount.0 00000100:00100000:0.0:1789708749.101317:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708749.101580:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426306048 00000100:00100000:3.0:1789708749.101588:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426306048 00000100:00100000:0.0:1789708749.101599:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426305920:0@lo:9:umount.0 00010000:00010000:1.0:1789708749.101613:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708749.101625:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708749.101630:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426306176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789708749.101633:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426306432 00000100:00100000:3.0:1789708749.101637:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426306432 00000100:00100000:0.0:1789708749.101694:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426306304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708749.101704:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708749.101740:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708749.101759:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426305792 00000100:00100000:2.0:1789708749.101763:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426305792 00000100:00100000:1.0:1789708749.101764:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426306176 00000100:00100000:1.0:1789708749.101770:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426306176 00000100:00100000:2.0:1789708749.101791:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426305920 00000100:00100000:2.0:1789708749.101796:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426305920 00000100:00100000:1.0:1789708749.101799:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426306304 00000100:00100000:1.0:1789708749.101804:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426306304 00000100:00100000:1.0:1789708749.101830:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789708749.101840:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:34efb293-a6d4-48d2-a113-9ec9a49feb73+21:3287:x1876645426306048:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708749.101846:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789708749.101855:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876645426305792:12345-0@lo:9:umount.0 00010000:00010000:1.0:1789708749.101865:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:2.0:1789708749.101879:0:6673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865fae 00010000:00010000:1.0:1789708749.101885:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa39600/0xa8f741d1c6866136 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa8f741d1c686612f expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789708749.101890:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8a1306f82000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789708749.101923:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:1.0:1789708749.101981:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708749.102105:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:34efb293-a6d4-48d2-a113-9ec9a49feb73+20:3287:x1876645426306048:12345-0@lo:103:ldlm_bl.0 Request processed in 265us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708749.102115:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789708749.102145:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789708749.102154:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1407f56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:34efb293-a6d4-48d2-a113-9ec9a49feb73+19:3288:x1876645426306176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708749.102164:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708749.102176:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa39800/0xa8f741d1c686605d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa8f741d1c6866056 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708749.102191:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708749.102225:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1407f56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:34efb293-a6d4-48d2-a113-9ec9a49feb73+18:3288:x1876645426306176:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708749.102232:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789708749.102280:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3285:x1876645426305792:12345-0@lo:9:umount.0 Request processed in 426us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708749.102287:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789708749.102300:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789708749.102307:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876645426305920:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789708749.102319:0:6673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6866087 00000100:00080000:2.0:1789708749.102325:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8a1306f86000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789708749.102348:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:0.0:1789708749.102360:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708749.102564:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3285:x1876645426305920:12345-0@lo:9:umount.0 Request processed in 257us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708749.102572:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789708749.102616:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789708749.102622:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a1410964800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789708749.102628:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:34efb293-a6d4-48d2-a113-9ec9a49feb73+17:3289:x1876645426306304:12345-0@lo:103:ldlm_bl.0 00000004:00080000:2.0:1789708749.102638:0:3285:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00010000:00010000:1.0:1789708749.102640:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:2.0:1789708749.102642:0:3285:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789708749.102671:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426305792:0@lo:9:umount.0 00010000:00010000:1.0:1789708749.102679:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1403b6a600/0xa8f741d1c6866358 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa8f741d1c6866351 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789708749.102686:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a14345ee000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:1.0:1789708749.102692:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1789708749.102699:0:3285:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789708749.102702:0:3285:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789708749.102706:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426305920:0@lo:9:umount.0 00010000:00010000:2.0:1789708749.102731:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708749.102734:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:34efb293-a6d4-48d2-a113-9ec9a49feb73+16:3289:x1876645426306304:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708749.102752:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789708749.107392:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34efb293-a6d4-48d2-a113-9ec9a49feb73:3287:1876645426306048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708749.107442:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34efb293-a6d4-48d2-a113-9ec9a49feb73:3288:1876645426306176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708749.107471:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34efb293-a6d4-48d2-a113-9ec9a49feb73:3289:1876645426306304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789708749.111336:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789708749.111352:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+15:3286:x1876645426306432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708749.111369:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708749.111396:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a14013a1600/0xa8f741d1c6865e11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa8f741d1c6865e0a expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708749.111416:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708749.111954:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34efb293-a6d4-48d2-a113-9ec9a49feb73+14:3286:x1876645426306432:12345-0@lo:103:ldlm_bl.0 Request processed in 606us (10677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708749.111974:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789708749.112065:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426306432:0@lo:103:ldlm_bl.0 00000001:00080000:3.0:1789708749.123150:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:3.0:1789708749.123169:0:5841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c9d2a103-cf70-4470-bdd0-387470668318 00000001:00080000:3.0:1789708749.123177:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1789708749.123181:0:5841:0:(genops.c:885:class_export_put()) final put ffff8a143ed01000/c9d2a103-cf70-4470-bdd0-387470668318 00000001:00080000:3.0:1789708749.123201:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1789708749.123208:0:5841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 14bb7f14-3461-47f6-86c9-db3f545050ad 00000001:00080000:3.0:1789708749.123213:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1789708749.123215:0:5841:0:(genops.c:885:class_export_put()) final put ffff8a1403188000/14bb7f14-3461-47f6-86c9-db3f545050ad 00000020:00000080:3.0:1789708749.123227:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a143ed01000/c9d2a103-cf70-4470-bdd0-387470668318 for lustre-MDT0000 00000020:00000080:3.0:1789708749.123421:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1403188000/14bb7f14-3461-47f6-86c9-db3f545050ad for lustre-MDT0000 00000020:00000080:3.0:1789708749.123451:0:485:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a143ed03800 for lustre-MDT0000 00000020:00000080:3.0:1789708749.123457:0:485:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a14076be000 for lustre-MDT0000 00000001:00100000:0.0:1789708749.128615:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 14bb7f14-3461-47f6-86c9-db3f545050ad 00000020:00000080:0.0:1789708749.128624:0:6697:0:(genops.c:885:class_export_put()) final put ffff8a1434bf9800/14bb7f14-3461-47f6-86c9-db3f545050ad 00000001:00100000:0.0:1789708749.128668:0:7627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14bb7f14-3461-47f6-86c9-db3f545050ad 00000020:00000080:0.0:1789708749.128672:0:7627:0:(genops.c:885:class_export_put()) final put ffff8a14059d2800/14bb7f14-3461-47f6-86c9-db3f545050ad 00000020:00000080:0.0:1789708749.128689:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1434bf9800/14bb7f14-3461-47f6-86c9-db3f545050ad for lustre-OST0000 00000020:00000080:0.0:1789708749.128728:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a14059d2800/14bb7f14-3461-47f6-86c9-db3f545050ad for lustre-OST0001 00000020:00000080:0.0:1789708749.128747:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a1434bfe800 for lustre-OST0000 00000020:00000080:0.0:1789708749.128751:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a13069bd800 for lustre-OST0001 00000020:00080000:2.0:1789708749.129078:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8a1403100000) has no exports 00000020:00000080:2.0:1789708749.191212:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865e65 00000020:00000080:2.0:1789708749.191232:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a1434bed800/lustre-QMT0000_UUID 00000020:01000000:2.0:1789708749.191413:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789708749.191558:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1434bed800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789708749.191583:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789708749.191593:0:12937:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789708749.191598:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8a1434428000) has no exports 00000020:00000080:1.0:1789708749.192220:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865e5e 00000020:00000080:1.0:1789708749.192229:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a1435c08800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789708749.192466:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1435c08800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789708749.192727:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789708749.192737:0:12937:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789708749.192740:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a1434426800/lustre-QMT0000_UUID 00000020:00000080:0.0:1789708749.192743:0:12937:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1434426800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789708749.192749:0:12937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1789708749.192940:0:12937:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a143f1f8580 - data ffff8a1422ff9af8/ffff8a130923f400 00000020:01000000:0.0:1789708749.193093:0:12937:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a140598f200 - data ffff8a1422c7ed80/ffff8a1402e4f800 00000001:00000004:0.0:1789708749.216297:0:12937:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:0.0:1789708749.242838:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789708749.313535:0:12937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789708749.313544:0:12937:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1789708749.313568:0:12937:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789708749.313570:0:12937:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789708749.314878:0:7163:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789708749.314884:0:7163:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789708749.314919:0:7163:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789708749.317925:0:12937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789708749.317932:0:12937:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1789708749.317951:0:12937:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789708749.317954:0:12937:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789708749.320305:0:7747:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789708749.320332:0:7747:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1789708749.320352:0:7747:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789708749.401691:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865e2d 00000020:00000080:3.0:1789708749.401705:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a1440cce000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789708749.402216:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1440cce000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789708749.405114:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865e42 00000020:00000080:3.0:1789708749.405131:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a1434420000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789708749.407593:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789708749.407621:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789708749.407631:0:12937:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789708749.407637:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8a1403104d40) has no exports 00000004:01000000:3.0:1789708749.407826:0:12937:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789708749.407838:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6866080 00000020:00000080:3.0:1789708749.407845:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a1302f78800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789708749.408527:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1434420000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789708749.408624:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789708749.408632:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789708749.408640:0:12937:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789708749.408644:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8a14077019c0) has no exports 00000020:00000080:3.0:1789708749.408676:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6866079 00000020:00000080:3.0:1789708749.408682:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a14345ea800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789708749.409049:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1302f78800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789708749.409062:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a14345ea800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789708749.409159:0:12937:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789708749.409164:0:12937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789708749.409168:0:12937:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1789708749.409172:0:12937:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789708749.409175:0:12937:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789708749.409628:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708749.409642:0:12937:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789708749.409673:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865f99 00000020:00000080:3.0:1789708749.409680:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a1440cc9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789708749.413132:0:485:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a14345ee000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789708749.413148:0:485:0:(genops.c:885:class_export_put()) final put ffff8a140318d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789708749.413152:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a140318d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789708749.413160:0:485:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789708749.414754:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789708749.414768:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789708749.414781:0:12937:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789708749.414787:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8a1407703380) has no exports 00000020:00000080:3.0:1789708749.414796:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865f92 00000020:00000080:3.0:1789708749.414805:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a1306f86800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789708749.415785:0:12937:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789708749.415793:0:12937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789708749.415797:0:12937:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1789708749.415805:0:12937:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789708749.415807:0:12937:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789708749.415854:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708749.415865:0:12937:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789708749.415901:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708749.415905:0:12937:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789708749.415910:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a1440cc9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789708749.415914:0:12937:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1440cc9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789708749.415921:0:12937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789708749.416181:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865e49 00000020:00000080:3.0:1789708749.416188:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a1434425800/lustre-MDD0000_UUID 00000020:01000000:3.0:1789708749.416261:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789708749.416267:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789708749.416271:0:12937:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789708749.416274:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8a143442cd40) has no exports 00000020:00000080:3.0:1789708749.416296:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708749.416299:0:12937:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789708749.416303:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865e50 00000020:00000080:3.0:1789708749.416308:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a1434424800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789708749.416318:0:12937:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1410604800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789708749.416321:0:12937:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1410604800 3 00000020:01000004:3.0:1789708749.416324:0:12937:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a1410604800 from lustre-MDT0000 00000020:00000080:3.0:1789708749.416342:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708749.416345:0:12937:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789708749.416347:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a1440cca800/lustre-MDT0000_UUID 00000020:00000080:3.0:1789708749.416349:0:12937:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1440cca800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789708749.416357:0:12937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789708749.416385:0:12937:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1789708749.416389:0:12937:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789708749.416392:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789708749.416394:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789708749.416397:0:12937:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789708749.416404:0:12937:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8a14037e1800 34efb293-a6d4-48d2-a113-9ec9a49feb73 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789708749.416409:0:12937:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8a1403103380) has exports, disconnecting them 00000020:00080000:3.0:1789708749.416420:0:12937:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a14037e1800), last request at 1789708583 00000020:00000080:3.0:1789708749.416437:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865dee 00000020:00010000:3.0:1789708749.416440:0:12937:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a14037e1800: total 4 00000100:00080000:3.0:1789708749.416444:0:12937:0:(import.c:65:import_set_state_nolock()) ffff8a14037e2800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789708749.416530:0:12937:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a14037e1800): rc 0 00000020:00080000:3.0:1789708749.416535:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8a1403103380) has no exports 00000100:00100000:1.0:1789708749.417121:0:5812:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a14030b2a00:5812] 0 exiting: rc = 1 00000020:00000080:1.0:1789708749.417213:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1440cc9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789708749.417223:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1306f86800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789708749.417230:0:485:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a1410964800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789708749.417236:0:485:0:(genops.c:885:class_export_put()) final put ffff8a1306f81800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789708749.417238:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1306f81800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789708749.417243:0:485:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789708749.417384:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1434425800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789708749.417389:0:485:0:(genops.c:885:class_export_put()) final put ffff8a1434421800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789708749.417390:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1434421800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789708749.417393:0:485:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789708749.417613:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1434424800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1789708749.417775:0:5813:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a14030b3800:5813] 1 exiting: rc = 0 00000100:00100000:3.0:1789708749.418152:0:5814:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a14030b3200:5814] 2 exiting: rc = 0 00000100:00100000:1.0:1789708749.418267:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418279:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418284:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418290:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418296:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418301:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418308:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418315:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418321:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418328:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418335:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418342:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418347:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418353:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418359:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418365:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418370:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418377:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418382:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418388:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418393:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418399:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418404:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418410:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418415:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418421:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418427:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418432:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418437:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418442:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418447:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418452:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418457:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418462:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418477:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418482:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418489:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418494:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418499:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418516:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418523:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418530:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418535:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418540:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418546:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418551:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418557:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418562:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418567:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418572:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418578:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418583:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418588:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418592:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418597:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418602:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418608:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418613:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418619:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418624:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418629:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418634:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418640:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789708749.418645:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789708749.419289:0:12937:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789708749.419293:0:12937:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:0.0:1789708749.421453:0:5807:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a14037e1800: total 0 00010000:00010000:0.0:1789708749.421531:0:5807:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a14037e1800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1789708749.421572:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a14013a0a00/0xa8f741d1c6865f06 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa8f741d1c6865eff expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.421594:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a14013a0600/0xa8f741d1c6866144 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa8f741d1c686613d expref: 8 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.421607:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1403b6a200/0xa8f741d1c68660fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa8f741d1c68660f7 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.421618:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa38400/0xa8f741d1c686633c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa8f741d1c6866335 expref: 6 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.421627:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400031200/0xa8f741d1c68660f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa8f741d1c68660e9 expref: 5 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.421638:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa38a00/0xa8f741d1c686610c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa8f741d1c6866105 expref: 4 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.421667:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c686634a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa8f741d1c6866343 expref: 3 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.421683:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400030a00/0xa8f741d1c686611a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa8f741d1c6866113 expref: 2 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708749.421693:0:5807:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a14037e1800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1789708749.421721:0:5807:0:(genops.c:885:class_export_put()) final put ffff8a14037e1800/34efb293-a6d4-48d2-a113-9ec9a49feb73 00010000:00010000:0.0:1789708749.421736:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708749.421738:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708749.421740:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789708749.421755:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a14037e1800/34efb293-a6d4-48d2-a113-9ec9a49feb73 for MGS 00000020:00000080:0.0:1789708749.421789:0:485:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a14037e2800 for MGS 00000020:01000000:1.0:1789708749.421943:0:12937:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a140aeb4f80 - data ffff8a13073ba288/ffff8a14050a4800 00000020:01000000:1.0:1789708749.422086:0:12937:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1405101400 - data ffff8a1422c6b510/ffff8a140375a800 00000020:00000080:1.0:1789708749.422794:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865dd2 00000020:00000080:1.0:1789708749.422809:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a1411b93800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789708749.422828:0:12937:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1410604800 from MGS, refs=2 00000020:01000004:1.0:1789708749.422832:0:12937:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1410604800 2 00000020:01000004:1.0:1789708749.422835:0:12937:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a1410604800 from MGS 00000020:00000080:1.0:1789708749.422860:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708749.422868:0:12937:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789708749.422871:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a14100cc800/MGS 00000020:00000080:1.0:1789708749.422873:0:12937:0:(genops.c:844:class_export_destroy()) destroying export ffff8a14100cc800/MGS for MGS 00000020:01000000:1.0:1789708749.422878:0:12937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789708749.422934:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789708749.422940:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708749.422945:0:12937:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789708749.422951:0:12937:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a1434bea800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789708749.422957:0:12937:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8a14345499c0) has exports, disconnecting them 00000020:00080000:1.0:1789708749.422961:0:12937:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a1434bea800), last request at 1789708583 00000020:00000080:1.0:1789708749.422965:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865e9d 00000020:00080000:1.0:1789708749.423073:0:12937:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1434bea800): rc 0 00000020:00000080:1.0:1789708749.423079:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a1434bea800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789708749.426341:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1411b93800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789708749.426360:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1434bea800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789708749.426977:0:12937:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789708749.426984:0:12937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789708749.426988:0:12937:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789708749.426994:0:12937:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789708749.427175:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789708749.427184:0:12937:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789708749.427191:0:12937:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1410604800 1 00000020:00000080:0.0:1789708749.427365:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865dc4 00000020:00000080:0.0:1789708749.427376:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a14100cd800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789708749.427383:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789708749.427388:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789708749.427393:0:12937:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789708749.427397:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8a1407ea3380) has no exports 00000020:00000080:3.0:1789708749.427466:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a1440ccf800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789708749.427473:0:36:0:(genops.c:885:class_export_put()) final put ffff8a1434bec800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789708749.427476:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1434bec800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789708749.427484:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1789708749.427569:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a14100cd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789708749.444402:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789708749.444417:0:12937:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789708749.444424:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a1410606800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789708749.444428:0:12937:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1410606800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789708749.444437:0:12937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789708749.444579:0:12937:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a1410603000 00000020:01000000:3.0:1789708749.444601:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789708749.444606:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789708749.444610:0:12937:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789708749.444615:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8a14031019c0) has no exports 00000100:00100000:3.0:1789708749.444705:0:5821:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8a14037b4000:5821] 2 exiting: rc = 0 00000100:00100000:3.0:1789708749.444796:0:11601:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff8a1306da5600:11601] 4 exiting: rc = 0 00000100:00100000:0.0:1789708749.447427:0:7140:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8a1426d87e00:7140] 3 exiting: rc = 0 00000100:00100000:0.0:1789708749.449761:0:5819:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8a140e17ac00:5819] 0 exiting: rc = 1 00000100:00100000:0.0:1789708749.451017:0:5820:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8a140e17a600:5820] 1 exiting: rc = 0 00000100:00100000:0.0:1789708749.452761:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452772:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452778:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452784:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452789:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452795:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452801:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452821:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452825:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452830:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452836:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452841:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452847:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452853:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452858:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452864:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452869:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452875:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452880:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452885:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452890:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452895:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452902:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452907:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452912:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452917:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452923:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452929:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452934:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452939:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452946:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452952:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452957:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452962:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452980:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452986:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452992:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.452997:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453003:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453008:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453013:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453018:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453031:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453036:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453041:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453046:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453052:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453057:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453062:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453067:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453073:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453079:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453084:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453090:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453096:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453101:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453107:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453112:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453118:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453123:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453129:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453135:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453141:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.453147:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.459427:0:5823:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8a1404cf5a00:5823] 1 exiting: rc = 0 00000100:00100000:2.0:1789708749.459956:0:5822:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8a1407f05000:5822] 0 exiting: rc = 1 00000100:00100000:0.0:1789708749.460562:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460570:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460576:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460584:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460589:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460594:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460601:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460606:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460612:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460617:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460623:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460629:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460645:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460675:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460680:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460686:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460691:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460697:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460702:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460706:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460711:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460717:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460722:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460727:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460732:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460737:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460742:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460747:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460753:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460758:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460764:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460769:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460774:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460778:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460784:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460789:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460793:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460798:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460803:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460808:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460812:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460817:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460822:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460827:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460832:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460836:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460841:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460851:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460856:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460862:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460867:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460872:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460877:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460883:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460889:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460894:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460898:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460903:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460908:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460913:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460919:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460924:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460929:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.460934:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708749.462248:0:5824:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8a140500f800:5824] 0 exiting: rc = 1 00000100:00100000:3.0:1789708749.462323:0:5825:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8a140500f400:5825] 1 exiting: rc = 0 00000100:00100000:0.0:1789708749.462431:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462438:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462445:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462450:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462456:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462461:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462467:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462473:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462478:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462483:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462500:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462518:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462524:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462530:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462535:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462541:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462547:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462553:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462568:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462574:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462580:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462586:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462603:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462609:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462615:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462621:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462627:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462632:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462673:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462679:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462685:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462691:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462697:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462703:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462722:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462732:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462738:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462744:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462750:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462756:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462762:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462767:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462773:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462779:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462795:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462801:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462819:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462825:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462831:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462837:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462844:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462849:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462855:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462867:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462874:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462880:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462886:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462900:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462906:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462912:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462918:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462923:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462929:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.462939:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708749.562266:0:5826:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8a1407e89a00:5826] 0 exiting: rc = 1 00000100:00100000:1.0:1789708749.562266:0:5827:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8a1407e88400:5827] 1 exiting: rc = 0 00000100:00100000:0.0:1789708749.562501:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.562517:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.562521:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.562525:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.562529:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.562631:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.562640:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.562644:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.563971:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.563985:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.563990:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.563995:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564000:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564006:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564011:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564016:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564021:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564026:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564031:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564036:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564041:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564046:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564051:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564056:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564079:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564083:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564087:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564091:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564095:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564100:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564107:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564112:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564117:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564121:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564126:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564131:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564136:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564140:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564145:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564150:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564155:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564159:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564164:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564169:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564173:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564178:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564182:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564187:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564191:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564195:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564201:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564205:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564209:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564213:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564219:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564223:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564227:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564231:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564236:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564248:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564253:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564258:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564263:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.564267:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708749.565381:0:5828:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8a1407e88c00:5828] 0 exiting: rc = 1 00000100:00100000:3.0:1789708749.565495:0:5829:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8a1407e89400:5829] 1 exiting: rc = 0 00000100:00100000:0.0:1789708749.565624:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.565630:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.565638:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.565643:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.565990:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566000:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566006:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566011:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566016:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566022:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566028:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566033:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566038:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566043:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566049:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566055:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566060:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566065:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566071:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566076:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566082:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566087:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566092:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566097:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566102:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566107:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566113:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566117:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566123:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566127:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566149:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566154:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566160:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566165:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566170:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566176:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566181:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566186:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566191:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566197:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566203:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566207:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566213:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566218:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566223:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566228:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566234:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566239:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566245:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566250:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566256:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566261:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566265:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566271:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566276:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566281:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566285:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566290:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566294:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566298:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566303:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566307:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566311:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.566316:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708749.566824:0:5831:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8a1407e88200:5831] 1 exiting: rc = 0 00000100:00100000:1.0:1789708749.567063:0:7625:0:(service.c:3188:ptlrpc_main()) mdt_fld_0002: service thread [ffff8a13084cc600:7625] 2 exiting: rc = 0 00000100:00100000:1.0:1789708749.567150:0:5830:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8a1407e88800:5830] 0 exiting: rc = 1 00000100:00100000:0.0:1789708749.567238:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567256:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567261:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567267:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567273:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567279:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567285:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567290:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567296:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567301:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567307:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567311:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567317:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567321:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567327:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567332:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567337:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567342:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567347:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567352:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567357:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567362:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567367:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567372:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567377:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567381:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567386:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567391:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567396:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567401:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567405:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567410:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567415:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567420:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567426:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567431:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567443:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567447:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567453:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567458:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567463:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567468:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567473:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567477:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567483:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567488:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567493:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567498:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567514:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567520:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567525:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567530:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567535:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567540:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567545:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567551:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567556:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567561:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567567:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567572:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567577:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567582:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567587:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.567592:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789708749.568784:0:5833:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8a1403555a00:5833] 1 exiting: rc = 0 00000100:00100000:0.0:1789708749.569150:0:5834:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8a1403554800:5834] 2 exiting: rc = 0 00000100:00100000:2.0:1789708749.569537:0:5832:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8a1403554a00:5832] 0 exiting: rc = 1 00000100:00100000:0.0:1789708749.569842:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569850:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569856:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569861:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569867:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569872:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569889:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569896:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569902:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569908:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569915:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569921:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569926:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569935:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569940:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569946:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569951:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569957:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569963:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569970:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569976:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569982:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569988:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.569995:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570000:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570007:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570013:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570019:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570025:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570031:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570037:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570060:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570068:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570074:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570079:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570085:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570090:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570096:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570102:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570108:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570113:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570126:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570131:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570136:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570141:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570147:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570152:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570157:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570163:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570169:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570174:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570180:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570185:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570190:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570196:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570214:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570220:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570225:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570230:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570235:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570240:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570245:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570250:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708749.570256:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789708749.580589:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789708749.580604:0:12937:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789708749.580610:0:12937:0:(genops.c:885:class_export_put()) final put ffff8a14030ee800/MDS_uuid 00000020:00000080:0.0:1789708749.580614:0:12937:0:(genops.c:844:class_export_destroy()) destroying export ffff8a14030ee800/MDS_uuid for MDS 00000020:01000000:0.0:1789708749.580621:0:12937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789708749.581131:0:12937:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789708750.267426:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708751.295003:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708752.323162:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789708752.606323:0:13090:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789708752.630320:0:13090:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789708752.630371:0:13090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c6866105 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686610c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708752.630388:0:13090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c6866105 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c686610c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708752.630396:0:13090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c6866105 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c686610c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708752.630403:0:13090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c6866105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c686610c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708752.630427:0:13090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789708752.630433:0:13090:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789708752.630457:0:13090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789708752.630462:0:13090:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789708752.630468:0:13090:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789708752.630502:0:13090:0:(import.c:65:import_set_state_nolock()) ffff8a1410961800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789708752.630679:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1876645426306560:0@lo:39:umount.0 00000400:00000100:3.0:1789708752.630739:0:3285:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645426306560 offset 0 length 224: 4 00010000:00010000:0.0:1789708752.630961:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708752.630969:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c6866105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c686610c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708752.630984:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14013a0c00 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:0.0:1789708752.631001:0:5807:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c6866105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c686610c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708752.631010:0:5807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c6866105 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa8f741d1c686610c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708752.631017:0:5807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c6866105 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa8f741d1c686610c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708752.631023:0:5807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789708752.631025:0:5807:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789708752.631027:0:5807:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789708752.631054:0:5807:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c6866105 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa8f741d1c686610c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708752.631060:0:5807:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789708752.631112:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1789708752.631243:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c6866105 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa8f741d1c686610c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708752.631252:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a14013a0c00/0xa8f741d1c6866105 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa8f741d1c686610c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708752.631265:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708752.631267:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708752.631269:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708752.631525:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426306688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789708752.631571:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708752.631881:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426306688 00000100:00100000:1.0:1789708752.631888:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426306688 00000100:00100000:1.0:1789708752.632094:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789708752.632103:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3286:x1876645426306688:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789708752.632110:0:5804:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789708752 with bad export cookie 12175272486854090222 00000100:00100000:1.0:1789708752.641298:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3286:x1876645426306688:12345-0@lo:103:ldlm_bl.0 Request processed in 9187us (9719us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789708752.641313:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789708752.641466:0:3286:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789708752.641489:0:3286:0:(import.c:65:import_set_state_nolock()) ffff8a1403ae2800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789708752.641494:0:3286:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.153@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1789708752.649370:0:3286:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.153@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789708752.649376:0:3286:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789708752.649386:0:3286:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13082bf100 x1876645426306688/t0(0) o103->MGC192.168.202.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789708768 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789708752.649402:0:3286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789708752.649405:0:3286:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789708752.649406:0:3286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789708752.649411:0:3286:0:(import.c:65:import_set_state_nolock()) ffff8a1403ae2800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708752.649415:0:3286:0:(import.c:545:import_select_connection()) MGC192.168.202.153@tcp: connect to NID 0@lo last attempt 148 00000100:00080000:2.0:1789708752.649431:0:3286:0:(import.c:666:import_select_connection()) MGC192.168.202.153@tcp: import ffff8a1403ae2800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1789708752.649910:0:3286:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13082bc380 x1876645426306816/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789708752.650069:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:34efb293-a6d4-48d2-a113-9ec9a49feb73:3285:1876645426306816:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1789708752.650122:0:3285:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876645426306816 offset 0 length 520: 4 00000100:00100000:0.0:1789708752.650187:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34efb293-a6d4-48d2-a113-9ec9a49feb73:3286:1876645426306688:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708753.339206:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789708753.658789:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) 34efb293-a6d4-48d2-a113-9ec9a49feb73->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789708753.658800:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) 34efb293-a6d4-48d2-a113-9ec9a49feb73->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789708753.659167:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876645426306944:0@lo:400:kworker.0 00000400:00000100:2.0:1789708753.659236:0:3288:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645426306944 offset 0 length 224: 4 00000001:00100000:2.0:1789708754.252612:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789708754.252622:0:6697:0:(genops.c:885:class_export_put()) final put ffff8a1306f83000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789708754.252744:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1306f83000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789708754.252797:0:485:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a1306f82000 for lustre-OST0000 00000001:00100000:2.0:1789708754.286954:0:7627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789708754.286964:0:7627:0:(genops.c:885:class_export_put()) final put ffff8a1306f82800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789708754.287152:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1306f82800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789708754.287211:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a1306f86000 for lustre-OST0001 00010000:00010000:2.0:1789708754.363118:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708755.396691:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708756.414064:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708757.436251:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789708757.690840:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) 34efb293-a6d4-48d2-a113-9ec9a49feb73->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789708757.690851:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) 34efb293-a6d4-48d2-a113-9ec9a49feb73->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789708757.691015:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426307072:0@lo:400:kworker.0 00000400:00000100:0.0:1789708757.691076:0:3289:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645426307072 offset 0 length 224: 4 00010000:00010000:2.0:1789708758.459774:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708759.483063:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708760.506766:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708761.531112:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708762.555322:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789708762.874878:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 34efb293-a6d4-48d2-a113-9ec9a49feb73->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789708762.874889:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 34efb293-a6d4-48d2-a113-9ec9a49feb73->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789708762.875093:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876645426307200:0@lo:400:kworker.0 00000400:00000100:0.0:1789708762.875151:0:3286:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645426307200 offset 0 length 224: 4 00000100:00100000:2.0:1789708762.875937:0:3285:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708752/real 1789708752] req@ffff8a13082bc380 x1876645426306816/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789708762 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708762.875962:0:3285:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a13082bc380 x1876645426306816/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789708762 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708762.875972:0:3285:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708752/real 1789708752] req@ffff8a14344f2680 x1876645426306560/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789708762 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708762.875983:0:3285:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a14344f2680 x1876645426306560/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789708762 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789708762.875995:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a1403ae2800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789708762.876017:0:3285:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789708762.876021:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:34efb293-a6d4-48d2-a113-9ec9a49feb73:3285:1876645426306816:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1789708762.876027:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a1410961800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789708762.876042:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1876645426306560:0@lo:39:umount.0 00000100:00080000:1.0:1789708762.876121:0:13090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789708762.876126:0:13090:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789708762.876130:0:13090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789708762.877024:0:13090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866113 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686611a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708762.877037:0:13090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866113 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c686611a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708762.877044:0:13090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866113 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c686611a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708762.877052:0:13090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c686611a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708762.877066:0:13090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708762.877073:0:13090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143efc5c00/0xa8f741d1c6866343 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686634a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708762.877079:0:13090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143efc5c00/0xa8f741d1c6866343 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c686634a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708762.877084:0:13090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143efc5c00/0xa8f741d1c6866343 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c686634a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708762.877091:0:13090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a143efc5c00/0xa8f741d1c6866343 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c686634a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708762.877117:0:13090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789708762.877121:0:13090:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789708762.877143:0:13090:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789708762.877147:0:13090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789708762.877152:0:13090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708762.877158:0:13090:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789708762.877162:0:13090:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8a1407ea4d40) has no exports 00000020:00080000:1.0:1789708762.877188:0:13090:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8a1407ea4d40) has no exports 00000020:01000000:1.0:1789708762.878865:0:13090:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a143f1f8a80 - data ffff8a140b2e8360/ffff8a1306e60800 00000020:01000000:1.0:1789708762.878992:0:13090:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1407f8ee80 - data ffff8a1413edd0d8/ffff8a1306fcfc00 00010000:00010000:0.0:1789708762.879639:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708762.879673:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c686611a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708762.879685:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14013a1000 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:0.0:1789708762.879700:0:5807:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c686611a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708762.879711:0:5807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa8f741d1c686611a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708762.879718:0:5807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa8f741d1c686611a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708762.879724:0:5807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789708762.879726:0:5807:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789708762.879729:0:5807:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789708762.879744:0:5807:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1403ae2800 00010000:00010000:0.0:1789708762.879748:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866113 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa8f741d1c686611a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708762.879755:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a14013a1000/0xa8f741d1c6866113 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa8f741d1c686611a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708762.879786:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708762.879790:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a143efc5c00/0xa8f741d1c6866343 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c686634a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708762.879795:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5c00 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:0.0:1789708762.879798:0:5807:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a143efc5c00/0xa8f741d1c6866343 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c686634a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708762.879805:0:5807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a143efc5c00/0xa8f741d1c6866343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa8f741d1c686634a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708762.879811:0:5807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a143efc5c00/0xa8f741d1c6866343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa8f741d1c686634a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708762.879816:0:5807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789708762.879818:0:5807:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789708762.879820:0:5807:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789708762.879827:0:5807:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1403ae2800 00010000:00010000:0.0:1789708762.879829:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a143efc5c00/0xa8f741d1c6866343 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa8f741d1c686634a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708762.879847:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a143efc5c00/0xa8f741d1c6866343 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa8f741d1c686634a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708762.879856:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708762.879858:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708762.879859:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789708762.879872:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 34efb293-a6d4-48d2-a113-9ec9a49feb73->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789708762.879876:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789708762.879885:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a1403ae2800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789708762.879892:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.153@tcp: connect to NID 0@lo last attempt 318 00000100:00080000:0.0:1789708762.879897:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.153@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789708762.879909:0:36:0:(import.c:666:import_select_connection()) MGC192.168.202.153@tcp: import ffff8a1403ae2800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1789708762.879940:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13082bf100 x1876645426307328/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1789708762.880137:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708762.883501:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:34efb293-a6d4-48d2-a113-9ec9a49feb73:3285:1876645426307328:0@lo:250:kworker.0 00000400:00000100:1.0:1789708762.883568:0:3285:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876645426307328 offset 0 length 520: 4 00100000:10000000:1.0:1789708762.894593:0:13090:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789708762.930465:0:13090:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865f22 00000020:00000080:2.0:1789708762.930475:0:13090:0:(genops.c:885:class_export_put()) final put ffff8a1306f84800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789708762.930494:0:13090:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a143fa6b000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789708762.930498:0:13090:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a143fa6b000 2 00000020:01000004:2.0:1789708762.930502:0:13090:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a143fa6b000 from lustre-OST0000 00000020:00000080:2.0:1789708762.930531:0:13090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789708762.930540:0:13090:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789708762.930543:0:13090:0:(genops.c:885:class_export_put()) final put ffff8a1403090000/lustre-OST0000_UUID 00000020:00000080:2.0:1789708762.930546:0:13090:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1403090000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789708762.930553:0:13090:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789708762.930595:0:13090:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789708762.930600:0:13090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789708762.930616:0:13090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789708762.930621:0:13090:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789708762.930627:0:13090:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8a1306f87800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789708762.930633:0:13090:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff8a1407ea0000) has exports, disconnecting them 00000020:00080000:2.0:1789708762.930638:0:13090:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8a1306f87800), last request at 1789708593 00000020:00000080:2.0:1789708762.930643:0:13090:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865f4c 00000020:00000080:0.0:1789708762.930728:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1306f84800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:2.0:1789708762.931030:0:13090:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1306f87800): rc 0 00000020:00000080:2.0:1789708762.931036:0:13090:0:(genops.c:885:class_export_put()) final put ffff8a1306f87800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789708762.932242:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1306f87800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789708762.932800:0:13090:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789708762.932806:0:13090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789708762.932810:0:13090:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789708762.932817:0:13090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789708762.932996:0:13090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789708762.933006:0:13090:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789708762.933013:0:13090:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a143fa6b000 1 00000020:00000080:2.0:1789708762.933019:0:13090:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865edc 00000020:00000080:2.0:1789708762.933025:0:13090:0:(genops.c:885:class_export_put()) final put ffff8a1434bea000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789708762.933030:0:13090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789708762.933033:0:13090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789708762.933037:0:13090:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789708762.933041:0:13090:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8a1402f799c0) has no exports 00000020:00000080:0.0:1789708762.933162:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a1410961800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789708762.933168:0:36:0:(genops.c:885:class_export_put()) final put ffff8a1306f85000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789708762.933171:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1306f85000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789708762.933176:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789708762.933240:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1434bea000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789708762.945192:0:13090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789708762.945207:0:13090:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789708762.945213:0:13090:0:(genops.c:885:class_export_put()) final put ffff8a143fa6f000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789708762.945218:0:13090:0:(genops.c:844:class_export_destroy()) destroying export ffff8a143fa6f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789708762.945225:0:13090:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789708762.945364:0:13090:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a143fa6b800 00000020:02000400:2.0:1789708762.945419:0:13090:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789708763.579511:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708764.602907:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708765.629856:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789708766.050449:0:13245:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789708766.074822:0:13245:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789708766.074902:0:13245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a0000/0xa8f741d1c68660e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68660f0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708766.074919:0:13245:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a0000/0xa8f741d1c68660e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c68660f0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708766.074927:0:13245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14013a0000/0xa8f741d1c68660e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c68660f0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708766.074933:0:13245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a14013a0000/0xa8f741d1c68660e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c68660f0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708766.074956:0:13245:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789708766.074962:0:13245:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789708766.074988:0:13245:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789708766.075001:0:13245:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a143f4e4a80 x1876645426306944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708769 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708766.075067:0:13245:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a14344f3b80 x1876645426307072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708773 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708766.075083:0:13245:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a14344f0700 x1876645426307200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708778 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708766.075114:0:13245:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789708766.075119:0:13245:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789708766.075148:0:13245:0:(import.c:65:import_set_state_nolock()) ffff8a1403090800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789708766.075200:0:8433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708766.075212:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a14013a0000/0xa8f741d1c68660e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c68660f0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708766.075219:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14013a0000 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:2.0:1789708766.075222:0:8433:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a14013a0000/0xa8f741d1c68660e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c68660f0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708766.075231:0:8433:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a14013a0000/0xa8f741d1c68660e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa8f741d1c68660f0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789708766.075238:0:8433:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a14013a0000/0xa8f741d1c68660e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa8f741d1c68660f0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708766.075244:0:8433:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789708766.075246:0:8433:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789708766.075248:0:8433:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789708766.075261:0:8433:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1403ae2800 00010000:00010000:2.0:1789708766.075265:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a14013a0000/0xa8f741d1c68660e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa8f741d1c68660f0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708766.075271:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a14013a0000/0xa8f741d1c68660e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa8f741d1c68660f0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708766.075282:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708766.075284:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708766.075286:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708766.075323:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1876645426307200:0@lo:400:kworker.0 00000100:00100000:2.0:1789708766.075365:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426307072:0@lo:400:kworker.0 00000100:00100000:2.0:1789708766.075393:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1876645426307456:0@lo:39:umount.0 00000400:00000100:2.0:1789708766.075447:0:3285:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876645426307456 offset 0 length 224: 4 00000100:00100000:0.0:1789708766.078824:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876645426306944:0@lo:400:kworker.0 00010000:00010000:0.0:1789708766.651463:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708767.675551:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789708767.995167:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 34efb293-a6d4-48d2-a113-9ec9a49feb73->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789708767.995178:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 34efb293-a6d4-48d2-a113-9ec9a49feb73->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789708768.699385:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708769.724024:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708770.749230:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708771.775335:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708772.795178:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789708773.115504:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 34efb293-a6d4-48d2-a113-9ec9a49feb73->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789708773.115513:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 34efb293-a6d4-48d2-a113-9ec9a49feb73->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1789708773.819446:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708774.843503:0:5808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708775.867176:0:8434:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708776.320647:0:3285:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708766/real 1789708766] req@ffff8a14344c1180 x1876645426307456/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789708776 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708776.320950:0:3285:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a14344c1180 x1876645426307456/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789708776 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789708776.321071:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a1403090800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789708776.321093:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1876645426307456:0@lo:39:umount.0 00000100:00080000:1.0:1789708776.321230:0:13245:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789708776.321235:0:13245:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789708776.321240:0:13245:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789708776.325224:0:13245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400030200/0xa8f741d1c68660f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68660fe expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708776.325254:0:13245:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400030200/0xa8f741d1c68660f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c68660fe expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708776.325263:0:13245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1400030200/0xa8f741d1c68660f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c68660fe expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708776.325297:0:13245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1400030200/0xa8f741d1c68660f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c68660fe expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708776.325325:0:13245:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708776.325333:0:13245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14014a9400/0xa8f741d1c6866335 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686633c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708776.325340:0:13245:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14014a9400/0xa8f741d1c6866335 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c686633c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708776.325346:0:13245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a14014a9400/0xa8f741d1c6866335 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c686633c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708776.325352:0:13245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a14014a9400/0xa8f741d1c6866335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa8f741d1c686633c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708776.325366:0:13245:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789708776.325370:0:13245:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789708776.325396:0:13245:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789708776.325401:0:13245:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789708776.325406:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708776.325412:0:13245:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789708776.325417:0:13245:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8a14344299c0) has no exports 00000020:00080000:1.0:1789708776.325443:0:13245:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8a14344299c0) has no exports 00000020:01000000:1.0:1789708776.327216:0:13245:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a143f1f8f00 - data ffff8a143a3aa1b0/ffff8a1402e4d000 00010000:00010000:0.0:1789708776.328002:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708776.328013:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1400030200/0xa8f741d1c68660f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c68660fe expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708776.328058:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400030200 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:0.0:1789708776.328064:0:5807:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1400030200/0xa8f741d1c68660f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c68660fe expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708776.328074:0:5807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1400030200/0xa8f741d1c68660f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa8f741d1c68660fe expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708776.328080:0:5807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1400030200/0xa8f741d1c68660f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa8f741d1c68660fe expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708776.328086:0:5807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789708776.328089:0:5807:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789708776.328092:0:5807:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1789708776.328108:0:5807:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1403ae2800 00010000:00010000:0.0:1789708776.328113:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1400030200/0xa8f741d1c68660f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa8f741d1c68660fe expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708776.328119:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1400030200/0xa8f741d1c68660f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa8f741d1c68660fe expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708776.328135:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708776.328139:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a14014a9400/0xa8f741d1c6866335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c686633c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708776.328144:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a9400 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:0.0:1789708776.328148:0:5807:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a14014a9400/0xa8f741d1c6866335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa8f741d1c686633c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708776.328154:0:5807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a14014a9400/0xa8f741d1c6866335 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa8f741d1c686633c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708776.328167:0:5807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a14014a9400/0xa8f741d1c6866335 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa8f741d1c686633c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708776.328172:0:5807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789708776.328175:0:5807:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789708776.328177:0:5807:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789708776.328182:0:5807:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1403ae2800 00010000:00010000:0.0:1789708776.328185:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a14014a9400/0xa8f741d1c6866335 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa8f741d1c686633c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708776.328192:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a14014a9400/0xa8f741d1c6866335 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa8f741d1c686633c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708776.328206:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708776.328208:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708776.328210:0:5807:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789708776.328383:0:13245:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1308169e00 - data ffff8a13071f3d80/ffff8a1426d3dc00 00010000:00010000:2.0:1789708776.329217:0:8433:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1789708776.347917:0:13245:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789708776.404559:0:13245:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865fed 00000020:00000080:2.0:1789708776.404568:0:13245:0:(genops.c:885:class_export_put()) final put ffff8a1307f08000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789708776.404585:0:13245:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1302f7e800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789708776.404589:0:13245:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1302f7e800 2 00000020:01000004:2.0:1789708776.404593:0:13245:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a1302f7e800 from lustre-OST0001 00000020:00000080:2.0:1789708776.404616:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789708776.404625:0:13245:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789708776.404628:0:13245:0:(genops.c:885:class_export_put()) final put ffff8a1307f0a000/lustre-OST0001_UUID 00000020:00000080:2.0:1789708776.404630:0:13245:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1307f0a000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789708776.404637:0:13245:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1789708776.405157:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1307f08000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:1.0:1789708776.405439:0:13245:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 34efb293-a6d4-48d2-a113-9ec9a49feb73->MGS 00010000:00010000:1.0:1789708776.405458:0:13245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1401691000/0xa8f741d1c6865eff lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa8f741d1c6865f06 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708776.405483:0:13245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1401691000/0xa8f741d1c6865eff lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa8f741d1c6865f06 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708776.405489:0:13245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1789708776.405492:0:13245:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1789708776.405495:0:13245:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1789708776.405509:0:13245:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1403ae2800 00010000:00010000:1.0:1789708776.405513:0:13245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1401691000/0xa8f741d1c6865eff lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa8f741d1c6865f06 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708776.405542:0:13245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686613d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa8f741d1c6866144 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708776.405549:0:13245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686613d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa8f741d1c6866144 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708776.405554:0:13245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789708776.405556:0:13245:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1789708776.405558:0:13245:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1789708776.405568:0:13245:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1403ae2800 00010000:00010000:1.0:1789708776.405570:0:13245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a14013a1800/0xa8f741d1c686613d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa8f741d1c6866144 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789708776.405586:0:13245:0:(import.c:65:import_set_state_nolock()) ffff8a1403ae2800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1789708776.405589:0:13245:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789708776.405592:0:13245:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789708776.405593:0:13245:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789708776.405597:0:13245:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789708776.405608:0:13245:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13082bf100 x1876645426307328/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789708777 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789708776.405642:0:13245:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789708776.405645:0:13245:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:0.0:1789708776.405930:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:34efb293-a6d4-48d2-a113-9ec9a49feb73:3285:1876645426307328:0@lo:250:kworker.0 10000000:01000000:1.0:1789708776.406117:0:13245:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789708776.406125:0:13245:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865de0 00000020:00000080:1.0:1789708776.406130:0:13245:0:(genops.c:885:class_export_put()) final put ffff8a14030eb800/34efb293-a6d4-48d2-a113-9ec9a49feb73 00000020:01000000:1.0:1789708776.406145:0:13245:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.153@tcp (flags='') 00000020:00000080:1.0:1789708776.406151:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708776.406157:0:13245:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.153@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789708776.406162:0:13245:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8a1407ea19c0) has no exports 00000020:00000080:0.0:1789708776.406208:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a14030eb800/34efb293-a6d4-48d2-a113-9ec9a49feb73 for MGC192.168.202.153@tcp 10000000:01000000:2.0:1789708776.406347:0:5816:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789708776.406437:0:13245:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.153@tcp: client import never connected 00000100:00080000:1.0:1789708776.406440:0:13245:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789708776.406442:0:13245:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789708776.406445:0:13245:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789708776.406446:0:13245:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789708776.406485:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789708776.406489:0:13245:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.153@tcp (uuid 34efb293-a6d4-48d2-a113-9ec9a49feb73) 00000020:01000000:1.0:1789708776.406495:0:13245:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789708776.406498:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789708776.406501:0:13245:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789708776.406506:0:13245:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8a130765f000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789708776.406511:0:13245:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff8a143454cd40) has exports, disconnecting them 00000020:00080000:1.0:1789708776.406515:0:13245:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8a130765f000), last request at 1789708603 00000020:00000080:1.0:1789708776.406519:0:13245:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6866017 00000020:00080000:1.0:1789708776.406529:0:13245:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a130765f000): rc 0 00000020:00000080:1.0:1789708776.406533:0:13245:0:(genops.c:885:class_export_put()) final put ffff8a130765f000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789708776.406779:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a1403ae2800 for MGC192.168.202.153@tcp 00000020:00000080:0.0:1789708776.406784:0:38:0:(genops.c:885:class_export_put()) final put ffff8a1405371000/34efb293-a6d4-48d2-a113-9ec9a49feb73 00000020:00000080:0.0:1789708776.406786:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1405371000/34efb293-a6d4-48d2-a113-9ec9a49feb73 for MGC192.168.202.153@tcp 00000020:01000000:0.0:1789708776.406791:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.153@tcp (34efb293-a6d4-48d2-a113-9ec9a49feb73) 00000020:00000080:0.0:1789708776.407206:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a130765f000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789708776.410996:0:13245:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789708776.411018:0:13245:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789708776.411023:0:13245:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789708776.411029:0:13245:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789708776.411200:0:5808:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1789708776.411362:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a1403090800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1789708776.411376:0:8434:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789708776.416225:0:5807:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1789708776.417397:0:8433:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1789708776.419303:0:5802:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8a1407f04800:5802] 0 exiting: rc = 1 00000100:00100000:2.0:1789708776.419402:0:5803:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8a14292c6a00:5803] 1 exiting: rc = 0 00000100:00100000:0.0:1789708776.419874:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.420146:0:8435:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8a1309270c00:8435] 3 exiting: rc = 0 00000100:00100000:2.0:1789708776.420558:0:5806:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8a14292c7000:5806] 2 exiting: rc = 0 00000100:00100000:2.0:1789708776.423315:0:5805:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8a14292c6c00:5805] 1 exiting: rc = 0 00000100:00100000:1.0:1789708776.426331:0:5804:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8a14292c7200:5804] 0 exiting: rc = 1 00000100:00100000:0.0:1789708776.426526:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426535:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426543:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426549:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426554:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426560:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426566:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426571:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426577:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426582:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426588:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426593:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426600:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426605:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426610:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426615:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426622:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426627:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426632:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426637:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426642:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426646:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426670:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426674:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426679:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426684:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426689:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.426693:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428266:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428284:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428289:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428294:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428298:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428304:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428309:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428315:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428320:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428326:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428331:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428336:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428342:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428347:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428353:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428359:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428363:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428368:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428373:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428378:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428382:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428387:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428392:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428397:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428403:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428407:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428413:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428419:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428424:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428430:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428435:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428440:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428445:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428450:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428455:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.428474:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789708776.430540:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789708776.430553:0:13245:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789708776.430558:0:13245:0:(genops.c:885:class_export_put()) final put ffff8a14076bf000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789708776.430564:0:13245:0:(genops.c:844:class_export_destroy()) destroying export ffff8a14076bf000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789708776.430573:0:13245:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1789708776.430627:0:13245:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1302f7e800 1 00000020:00000080:0.0:1789708776.430633:0:13245:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa8f741d1c6865fbc 00000020:00000080:0.0:1789708776.430639:0:13245:0:(genops.c:885:class_export_put()) final put ffff8a143fa68800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789708776.430678:0:13245:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789708776.430683:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789708776.430688:0:13245:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789708776.430692:0:13245:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8a143442b380) has no exports 00000020:00000080:2.0:1789708776.430895:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a143fa68800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789708776.459780:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789708776.459795:0:13245:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789708776.459801:0:13245:0:(genops.c:885:class_export_put()) final put ffff8a1302f7f800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789708776.459806:0:13245:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1302f7f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789708776.459815:0:13245:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789708776.460060:0:13245:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a1302f7b000 00000020:01000000:0.0:1789708776.460095:0:13245:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789708776.460100:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789708776.460105:0:13245:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789708776.460110:0:13245:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8a1402f7cd40) has no exports 00000020:00000080:0.0:1789708776.460137:0:13245:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789708776.460144:0:13245:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789708776.460147:0:13245:0:(genops.c:885:class_export_put()) final put ffff8a1434bef800/OSS_uuid 00000020:00000080:0.0:1789708776.460150:0:13245:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1434bef800/OSS_uuid for OSS 00000020:01000000:0.0:1789708776.460155:0:13245:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1789708776.460475:0:5815:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789708776.462700:0:6673:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8a140510cc00:6673] 2 exiting: rc = 0 00000100:00100000:2.0:1789708776.462780:0:6670:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8a1434444200:6670] 0 exiting: rc = 1 00000100:00100000:2.0:1789708776.462834:0:11993:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff8a1407e20a00:11993] 4 exiting: rc = 0 00000100:00100000:0.0:1789708776.463887:0:10424:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8a1435d33e00:10424] 3 exiting: rc = 0 00000100:00100000:0.0:1789708776.467773:0:6672:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8a140510c200:6672] 1 exiting: rc = 0 00000100:00100000:2.0:1789708776.468179:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468191:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468198:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468203:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468209:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468214:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468219:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468225:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468230:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468235:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468241:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468260:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468266:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468272:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468277:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468303:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468310:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468316:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468322:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468326:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468330:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468336:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468341:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468346:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468351:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468356:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468361:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468366:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468370:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468392:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468397:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468405:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468411:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468415:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468420:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468424:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468430:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468434:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468439:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468444:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468449:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468455:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468460:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468465:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468470:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468475:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468480:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468487:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468493:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468498:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468504:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468509:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468514:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468520:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468525:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468530:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468536:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468541:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468547:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468551:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468557:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468562:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468568:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.468573:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.471299:0:6675:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8a140510d600:6675] 1 exiting: rc = 0 00000100:00100000:2.0:1789708776.471852:0:6674:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8a140510c600:6674] 0 exiting: rc = 1 00000100:00100000:2.0:1789708776.471917:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.471925:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.471931:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.471936:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.471942:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.471947:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.471952:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.471958:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.471964:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.471969:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.471975:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.471980:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.471987:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.471992:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.471998:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472003:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472008:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472014:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472019:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472024:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472030:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472035:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472039:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472044:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472062:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472068:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472076:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472082:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472086:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472091:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472096:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472101:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472106:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472112:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472129:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472134:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472138:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472143:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472147:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472152:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472157:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472161:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472165:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472170:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472175:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472180:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472184:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472188:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472193:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472197:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472202:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472206:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472211:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472215:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472220:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472225:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472230:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472235:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472240:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472341:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472348:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472353:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472358:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.472363:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.473683:0:6677:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8a1434445400:6677] 1 exiting: rc = 0 00000100:00100000:3.0:1789708776.474988:0:6676:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8a1434445000:6676] 0 exiting: rc = 1 00000100:00100000:2.0:1789708776.475433:0:6678:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8a143f907800:6678] 2 exiting: rc = 0 00000100:00100000:2.0:1789708776.475501:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475509:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475515:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475532:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475538:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475544:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475550:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475556:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475562:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475568:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475574:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475581:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475586:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475591:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475597:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475602:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475608:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475614:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475619:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475625:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475631:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475637:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475642:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475665:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475672:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475695:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475702:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475708:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475713:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475719:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475725:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475730:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475735:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475740:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475746:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475751:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475756:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475761:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475775:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475781:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475787:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475792:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475798:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475803:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475809:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475815:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475820:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475826:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475831:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475837:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475842:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475848:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475854:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475859:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475875:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475881:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475900:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475906:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475912:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475918:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475924:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475929:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475935:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.475941:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.568339:0:6680:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8a143f906000:6680] 1 exiting: rc = 0 00000100:00100000:3.0:1789708776.568573:0:6679:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8a143f907a00:6679] 0 exiting: rc = 1 00000100:00100000:0.0:1789708776.572294:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572321:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572326:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572331:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572337:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572342:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572346:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572351:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572356:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572361:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572366:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572371:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572376:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572382:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572388:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572393:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572399:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572405:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572410:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572415:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572421:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572426:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572431:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572436:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572442:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572447:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572452:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572458:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572463:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572468:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572473:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572477:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572482:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572487:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572492:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572497:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572509:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572515:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572520:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572526:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572531:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572535:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572541:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572546:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572558:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572563:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572569:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572575:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572580:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572586:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572591:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572596:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572602:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572607:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572612:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572617:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572622:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572627:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572632:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572637:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572642:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572932:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572942:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.572948:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789708776.574618:0:6681:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8a143f907000:6681] 0 exiting: rc = 1 00000100:00100000:1.0:1789708776.580983:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8a140510ca00:6682] 1 exiting: rc = 0 00000100:00100000:0.0:1789708776.581617:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581634:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581642:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581675:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581682:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581688:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581701:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581728:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581734:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581740:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581747:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581753:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581759:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581766:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581772:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581778:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581784:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581790:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581851:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581860:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581866:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581873:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581881:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581888:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581897:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581905:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581912:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581918:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581923:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581929:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581951:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581958:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581963:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581969:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581990:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.581996:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582002:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582008:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582013:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582020:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582026:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582032:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582071:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582079:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582085:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582091:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582097:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582102:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582108:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582115:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582122:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582127:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582134:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582140:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582160:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582168:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582173:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582179:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582186:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582191:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582197:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582202:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582208:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789708776.582214:0:13245:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789708777.067900:0:13245:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789708795.162741:0:13866:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789708803.855502:0:14326:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789708803.855508:0:14326:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789708803.856012:0:14326:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a1306dcb000 00000020:01000004:1.0:1789708803.856034:0:14326:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789708803.856041:0:14326:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789708803.856056:0:14326:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a1407703380) 00000020:00000080:1.0:1789708803.856070:0:14326:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789708803.892530:0:14326:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789708803.899820:0:14326:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789708803.900432:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 423: rc = 0 00100000:10000000:2.0:1789708803.901321:0:14326:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789708803.901543:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 423: rc = 0 00100000:10000000:2.0:1789708803.901913:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 423: rc = 0 00100000:10000000:2.0:1789708803.902035:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 423: rc = 0 00100000:10000000:2.0:1789708803.902355:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 423: rc = 0 00100000:10000000:2.0:1789708803.902622:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 423: rc = 0 00100000:10000000:2.0:1789708803.903543:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 425: rc = 0 00100000:10000000:2.0:1789708803.906014:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 302: rc = 0 00100000:10000000:2.0:1789708803.906126:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 302: rc = 0 00100000:10000000:2.0:1789708803.907551:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 645: rc = 0 00100000:10000000:2.0:1789708803.908534:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1789708803.909307:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1789708803.909592:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1789708803.909895:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 645: rc = 0 00100000:10000000:2.0:1789708803.910162:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 645: rc = 0 00100000:10000000:2.0:1789708803.910407:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 645: rc = 0 00100000:10000000:2.0:1789708803.910699:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1789708803.910959:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 645: rc = 0 00100000:10000000:2.0:1789708803.911212:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1789708803.911458:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 645: rc = 0 00100000:10000000:2.0:1789708803.911719:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 645: rc = 0 00100000:10000000:2.0:1789708803.913074:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 775: rc = 0 00100000:10000000:3.0:1789708803.914080:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 775: rc = 0 00100000:10000000:3.0:1789708803.914758:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 775: rc = 0 00100000:10000000:3.0:1789708803.915105:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 775: rc = 0 00100000:10000000:3.0:1789708803.915796:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 775: rc = 0 00100000:10000000:3.0:1789708803.916230:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 775: rc = 0 00100000:10000000:3.0:1789708803.917119:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 775: rc = 0 00100000:10000000:3.0:1789708803.918114:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 775: rc = 0 00100000:10000000:3.0:1789708803.918787:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 775: rc = 0 00100000:10000000:3.0:1789708803.919500:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 775: rc = 0 00100000:10000000:3.0:1789708803.920086:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 775: rc = 0 00100000:10000000:3.0:1789708803.920581:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 775: rc = 0 00100000:10000000:3.0:1789708803.921484:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 775: rc = 0 00100000:10000000:3.0:1789708803.922046:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 775: rc = 0 00100000:10000000:3.0:1789708803.922527:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 775: rc = 0 00100000:10000000:3.0:1789708803.925072:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 775: rc = 0 00100000:10000000:3.0:1789708803.927128:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 775: rc = 0 00100000:10000000:3.0:1789708803.928096:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 775: rc = 0 00100000:10000000:3.0:1789708803.929064:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 775: rc = 0 00100000:10000000:3.0:1789708803.929552:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 775: rc = 0 00100000:10000000:3.0:1789708803.930103:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 775: rc = 0 00100000:10000000:3.0:1789708803.930933:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 775: rc = 0 00100000:10000000:3.0:1789708803.931259:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 775: rc = 0 00100000:10000000:3.0:1789708803.931914:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 775: rc = 0 00100000:10000000:3.0:1789708803.932204:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 775: rc = 0 00100000:10000000:3.0:1789708803.934461:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 775: rc = 0 00100000:10000000:3.0:1789708803.934870:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 775: rc = 0 00100000:10000000:3.0:1789708803.935131:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 775: rc = 0 00100000:10000000:3.0:1789708803.935958:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 775: rc = 0 00100000:10000000:3.0:1789708803.936237:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 775: rc = 0 00100000:10000000:3.0:1789708803.936826:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 775: rc = 0 00100000:10000000:3.0:1789708803.937239:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 775: rc = 0 00100000:10000000:3.0:1789708803.938093:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 659: rc = 0 00100000:10000000:3.0:1789708803.939553:0:14326:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1789708803.940198:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 303: rc = 0 00100000:10000000:3.0:1789708803.942051:0:14326:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1789708803.942148:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 303: rc = 0 00100000:10000000:3.0:1789708803.942381:0:14326:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1789708803.942447:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 303: rc = 0 00100000:10000000:3.0:1789708803.943814:0:14326:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1789708803.944116:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 306: rc = 0 00100000:10000000:3.0:1789708803.944543:0:14326:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1789708803.944923:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 306: rc = 0 00100000:10000000:3.0:1789708803.945230:0:14326:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1789708803.945452:0:14326:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 306: rc = 0 00000020:00000080:2.0:1789708803.946134:0:14326:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789708803.946143:0:14326:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789708803.946226:0:14326:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa8f741d1c68670d3 00000020:01000004:2.0:1789708803.946236:0:14326:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789708803.946242:0:14326:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789708803.946249:0:14326:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a1306dcb000 from MGS 00000020:01000004:2.0:1789708803.946252:0:14326:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789708803.946262:0:14326:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a1402f7cd40) 00000020:00000080:2.0:1789708803.946335:0:14326:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789708803.946475:0:14326:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1306dcb000 from MGS, refs=2 00080000:01000000:2.0:1789708803.946481:0:14326:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789708803.946487:0:14326:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa8f741d1c68670e1 00000100:00100000:2.0:1789708803.950599:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789708803.950829:0:14326:0:(service.c:3474:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789708803.950945:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789708803.951799:0:14326:0:(service.c:3474:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789708803.951810:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789708803.954240:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708803.954803:0:14326:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789708803.954812:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789708803.955776:0:14326:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789708803.955786:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789708803.956265:0:14326:0:(service.c:3474:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789708803.956347:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789708803.958095:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708803.958101:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708803.958103:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708803.960089:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708803.960096:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708803.960099:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708803.961516:0:14326:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789708803.973349:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789708803.986553:0:14326:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789708803.986646:0:14326:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789708803.986907:0:14326:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789708803.989533:0:14335:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789708803.989797:0:14326:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789708803.990043:0:14326:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789708803.991735:0:14326:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789708803.992547:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789708803.992755:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789708803.992762:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789708803.996955:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789708803.996967:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789708804.007022:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789708804.007044:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789708804.010536:0:14326:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000100:00080000:1.0:1789708804.010606:0:14340:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:0.0:1789708804.010747:0:14326:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.153@tcp' 00000020:01000004:0.0:1789708804.010769:0:14326:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789708804.010837:0:14326:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.153@tcp (typ=mgc) 00000020:00000080:1.0:1789708804.010850:0:14326:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.153@tcp (ffff8a14077019c0) 00000020:00000080:1.0:1789708804.010868:0:14326:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789708804.010946:0:14326:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1304960800@MGC192.168.202.153@tcp: add connection 192.168.202.153@tcp at head 00010000:00010000:1.0:1789708804.011123:0:14326:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.153@tcp-0 is initialized 00000040:01000000:1.0:1789708804.011128:0:14326:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789708804.012687:0:14341:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789708804.012797:0:14326:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.153@tcp (uuid cdca603d-b230-4a0c-9898-90b77d1d9d18) 00000020:00000080:2.0:1789708804.012815:0:14326:0:(genops.c:1384:class_connect()) connect: client cdca603d-b230-4a0c-9898-90b77d1d9d18, cookie 0xa8f741d1c68670ef 00000100:00080000:2.0:1789708804.012823:0:14326:0:(import.c:545:import_select_connection()) MGC192.168.202.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789708804.012842:0:14326:0:(import.c:666:import_select_connection()) MGC192.168.202.153@tcp: import ffff8a1304960800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1789708804.013022:0:14326:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a14344f3100 x1876645426307584/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708804.013086:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cdca603d-b230-4a0c-9898-90b77d1d9d18:3285:1876645426307584:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789708804.013153:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789708804.013219:0:14326:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cdca603d-b230-4a0c-9898-90b77d1d9d18->MGS 00000020:01000004:2.0:1789708804.013241:0:14326:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789708804.013246:0:14326:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789708804.013257:0:14326:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8a1402f799c0) 00000020:00000080:2.0:1789708804.013268:0:14326:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789708804.013529:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426307584 00000100:00100000:1.0:1789708804.013536:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426307584 00000100:00100000:1.0:1789708804.013735:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789708804.013744:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140509f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3285:x1876645426307584:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789708804.014963:0:14337:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from cdca603d-b230-4a0c-9898-90b77d1d9d18@0@lo t0 exp 0000000000000000 cur 369 last 0 00000020:00000080:1.0:1789708804.014999:0:14337:0:(genops.c:1384:class_connect()) connect: client cdca603d-b230-4a0c-9898-90b77d1d9d18, cookie 0xa8f741d1c68670fd 00000100:00080000:1.0:1789708804.015122:0:14337:0:(import.c:65:import_set_state_nolock()) ffff8a1304965800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708804.015207:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140509f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+5:3285:x1876645426307584:12345-0@lo:250:mount.lustre.0 Request processed in 1462us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708804.015216:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789708804.015316:0:3285:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789708804.015325:0:3285:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.153@tcp: connect to target with instance 0 00000100:00080000:0.0:1789708804.015332:0:3285:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789708804.015336:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789708804.015339:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a1304960800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789708804.015342:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789708804.015357:0:3285:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789708804.015556:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cdca603d-b230-4a0c-9898-90b77d1d9d18:3285:1876645426307584:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789708804.045299:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789708804.045845:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789708804.045853:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789708804.047930:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789708804.047943:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789708804.049088:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789708804.049099:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789708804.050616:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789708804.051375:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789708804.051384:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789708804.052262:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789708804.052270:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789708804.135310:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708804.135582:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789708804.135590:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789708804.138994:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789708804.139012:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789708804.140123:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708804.140300:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789708804.140306:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789708804.141014:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789708804.141027:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789708804.142179:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708804.142349:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789708804.142355:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789708804.143080:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789708804.143096:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789708804.144090:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789708804.144247:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789708804.144253:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789708804.144932:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789708804.144939:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789708804.181389:0:14326:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708804.181966:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789708804.181974:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789708804.184372:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789708804.184389:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789708804.188893:0:14326:0:(service.c:3474:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789708804.188912:0:14326:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789708804.190588:0:14326:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789708804.190616:0:14326:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789708804.190623:0:14326:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789708804.190811:0:14326:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789708804.190855:0:14326:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.153@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789708804.190859:0:14326:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789708804.190861:0:14326:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789708804.190862:0:14326:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708804.190863:0:14326:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708804.190873:0:14326:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708804.190874:0:14326:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708804.190875:0:14326:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789708804.190877:0:14326:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789708804.190879:0:14326:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708804.190880:0:14326:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789708804.190883:0:14326:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789708804.190885:0:14326:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789708804.190886:0:14326:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789708804.190887:0:14326:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708804.190888:0:14326:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708804.190889:0:14326:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708804.190895:0:14326:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708804.190896:0:14326:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789708804.190897:0:14326:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789708804.190897:0:14326:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708804.190898:0:14326:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789708804.190935:0:14326:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789708804.190956:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426307712:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789708804.191049:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708804.191099:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f417cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708804.191523:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426307712 00000100:00100000:1.0:1789708804.191532:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426307712 00000100:00100000:1.0:1789708804.191581:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708804.191591:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140509c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+5:14326:x1876645426307712:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789708804.191944:0:14339:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789708804.191948:0:14339:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789708804.191951:0:14339:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789708804.193448:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789708804.193949:0:14339:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1789708804.195294:0:14361:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789708804.195302:0:14361:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789708804.195305:0:14361:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789708804.195342:0:14361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1789708804.195990:0:14339:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789708804.196002:0:14339:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789708804.203480:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140509c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+5:14326:x1876645426307712:12345-0@lo:253:mount.lustre.0 Request processed in 11881us (12421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708804.203502:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789708804.203699:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426307712:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789708804.203717:0:14326:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789708804.203720:0:14326:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789708804.203722:0:14326:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789708804.203724:0:14326:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708804.203725:0:14326:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708804.203726:0:14326:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708804.203728:0:14326:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708804.203729:0:14326:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789708804.203731:0:14326:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789708804.203733:0:14326:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708804.203734:0:14326:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789708804.203945:0:14326:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a1306dcb000 from lustre-MDT0000 10000000:01000000:3.0:1789708804.203985:0:14326:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789708804.203989:0:14326:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789708804.203993:0:14326:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a14077019c0 10000000:01000000:3.0:1789708804.203998:0:14326:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789708804.204007:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a14077019c0 from 1 10000000:01000000:3.0:1789708804.204010:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789708804.204052:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c6867104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.204063:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c6867104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.204088:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c6867104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708804.204109:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426307840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708804.204148:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708804.204190:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1407cae3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708804.204258:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426307840 00000100:00100000:1.0:1789708804.204265:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426307840 00000100:00100000:1.0:1789708804.204301:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708804.204310:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140509d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+5:14326:x1876645426307840:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708804.204322:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708804.204337:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143efc4800/0xa8f741d1c686710b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6867104 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708804.204359:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143efc4800/0xa8f741d1c686710b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6867104 expref: 6 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708804.204382:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143efc4800/0xa8f741d1c686710b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6867104 expref: 6 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708804.204391:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4800, rc 0) 00000100:00100000:1.0:1789708804.204430:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140509d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+6:14326:x1876645426307840:12345-0@lo:101:mount.lustre.0 Request processed in 122us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708804.204436:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708804.204689:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426307840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708804.204702:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c6867104 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686710b expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.204710:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c6867104 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c686710b expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708804.205084:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426307968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708804.205118:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708804.205138:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1407cae3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708804.205315:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426307968 00000100:00100000:2.0:1789708804.205321:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426307968 00000100:00100000:2.0:1789708804.205358:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789708804.205365:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+6:14326:x1876645426307968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708804.205610:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+6:14326:x1876645426307968:12345-0@lo:501:mount.lustre.0 Request processed in 244us (491us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789708804.205618:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789708804.206340:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426307968:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789708804.206375:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789708804.206397:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c6867104 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686710b expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.206407:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c6867104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686710b expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708804.206416:0:14326:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a1306dcb000 10000000:01000000:3.0:1789708804.206421:0:14326:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789708804.206433:0:14326:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a1306dcb000 10000000:01000000:3.0:1789708804.206436:0:14326:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789708804.206449:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a1306dcb000 from 1 10000000:01000000:3.0:1789708804.206452:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789708804.206479:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa39e00/0xa8f741d1c6867112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.206488:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143fa39e00/0xa8f741d1c6867112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.206498:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143fa39e00/0xa8f741d1c6867112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708804.206513:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426308096:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708804.206549:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708804.206585:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1407cae3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708804.206770:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426308096 00000100:00100000:2.0:1789708804.206777:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426308096 00000100:00100000:2.0:1789708804.206826:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789708804.206833:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+6:14326:x1876645426308096:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708804.206845:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708804.206859:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1403b6a400/0xa8f741d1c6867119 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6867112 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708804.206891:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1403b6a400/0xa8f741d1c6867119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6867112 expref: 7 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708804.206902:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1403b6a400/0xa8f741d1c6867119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6867112 expref: 7 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708804.206910:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6a400, rc 0) 00000100:00100000:2.0:1789708804.206952:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+7:14326:x1876645426308096:12345-0@lo:101:mount.lustre.0 Request processed in 119us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708804.206958:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789708804.207095:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426308096:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708804.207108:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143fa39e00/0xa8f741d1c6867112 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867119 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.207117:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143fa39e00/0xa8f741d1c6867112 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6867119 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708804.207129:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789708804.207146:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa39e00/0xa8f741d1c6867112 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867119 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.207153:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa39e00/0xa8f741d1c6867112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867119 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708804.207171:0:14326:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789708804.207175:0:14326:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789708804.207179:0:14326:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a1306dcb000 10000000:01000000:3.0:1789708804.207181:0:14326:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789708804.207185:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789708804.207187:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789708804.207201:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38c00/0xa8f741d1c6867120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.207208:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143fa38c00/0xa8f741d1c6867120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.207216:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143fa38c00/0xa8f741d1c6867120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708804.207229:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426308224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708804.207256:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708804.207284:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426308224 00000100:00100000:3.0:1789708804.207289:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426308224 00000100:00100000:3.0:1789708804.207313:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789708804.207319:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+7:14326:x1876645426308224:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708804.207325:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708804.207335:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa38200/0xa8f741d1c6867127 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6867120 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.207348:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa38200/0xa8f741d1c6867127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6867120 expref: 8 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.207369:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa38200/0xa8f741d1c6867127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6867120 expref: 8 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.207376:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38200, rc 0) 00000100:00100000:3.0:1789708804.207400:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+8:14326:x1876645426308224:12345-0@lo:101:mount.lustre.0 Request processed in 81us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708804.207407:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789708804.207434:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1407cae3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708804.207460:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426308224:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708804.207470:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143fa38c00/0xa8f741d1c6867120 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867127 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.207478:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38c00/0xa8f741d1c6867120 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6867127 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708804.207518:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426308352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708804.207542:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708804.207561:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426308352 00000100:00100000:3.0:1789708804.207565:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426308352 00000100:00100000:3.0:1789708804.207584:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789708804.207590:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+8:14326:x1876645426308352:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708804.208053:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+9:14326:x1876645426308352:12345-0@lo:501:mount.lustre.0 Request processed in 462us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708804.208061:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789708804.208089:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1407cae3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708804.208102:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426308352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708804.208147:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426308480:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708804.208187:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708804.208209:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426308480 00000100:00100000:3.0:1789708804.208213:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426308480 00000100:00100000:3.0:1789708804.208236:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789708804.208242:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+9:14326:x1876645426308480:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708804.208553:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+9:14326:x1876645426308480:12345-0@lo:503:mount.lustre.0 Request processed in 310us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708804.208560:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789708804.208595:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402e6b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789708804.208607:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426308480:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708804.210223:0:14362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdca603d-b230-4a0c-9898-90b77d1d9d18:14362:1876645426308608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708804.210291:0:14362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708804.210382:0:14362:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1406324c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789708804.210518:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426308608 00000100:00100000:3.0:1789708804.210526:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426308608 00000100:00100000:3.0:1789708804.210564:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789708804.210572:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+9:14362:x1876645426308608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708804.211111:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+9:14362:x1876645426308608:12345-0@lo:502:llog_process_th.0 Request processed in 538us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708804.211120:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789708804.211227:0:14362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdca603d-b230-4a0c-9898-90b77d1d9d18:14362:1876645426308608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789708804.211255:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708804.211267:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708804.211269:0:14362:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789708804.211274:0:14362:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789708804.211278:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789708804.211293:0:14362:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a1407704d40) 00000020:00000080:1.0:1789708804.211313:0:14362:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789708804.211318:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789708804.211388:0:14362:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789708804.211395:0:14362:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa8f741d1c6867135 00000020:00000080:1.0:1789708804.211729:0:14362:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789708804.211735:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708804.211738:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708804.211740:0:14362:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789708804.211743:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708804.211746:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708804.211748:0:14362:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789708804.211774:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789708804.211782:0:14362:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a1407700000) 00000020:00000080:1.0:1789708804.211793:0:14362:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789708804.211798:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789708804.211800:0:14362:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789708804.211803:0:14362:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789708804.211811:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789708804.211851:0:14362:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1306dcb000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789708804.211996:0:14362:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a143d323380) 00000020:00000080:1.0:1789708804.212006:0:14362:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789708804.212064:0:14362:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789708804.212071:0:14362:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa8f741d1c686714a 00000020:00000080:1.0:1789708804.212164:0:14362:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789708804.212170:0:14362:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789708804.212175:0:14362:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa8f741d1c6867151 00080000:01000000:1.0:1789708804.212180:0:14362:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789708804.212183:0:14362:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa8f741d1c6867158 00010000:00010000:3.0:1789708804.320516:0:14362:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789708804.321721:0:14362:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1789708804.321985:0:14362:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789708804.322559:0:14362:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a143442b380) 00000020:00000080:3.0:1789708804.322580:0:14362:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789708804.322638:0:14362:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789708804.322645:0:14362:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa8f741d1c6867166 00000020:00000080:0.0:1789708804.333406:0:14362:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789708804.339414:0:14362:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa8f741d1c686716d 00000020:00000080:0.0:1789708804.340243:0:14362:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789708804.340257:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708804.340265:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708804.340267:0:14362:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789708804.340270:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789708804.340274:0:14362:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1789708804.340276:0:14362:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789708804.340277:0:14362:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789708804.340279:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789708804.340281:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708804.340283:0:14362:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789708804.340286:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708804.340290:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708804.340291:0:14362:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789708804.340296:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789708804.340334:0:14362:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789708804.340347:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708804.340350:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708804.340358:0:14362:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789708804.340362:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789708804.340365:0:14362:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789708804.340367:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708804.340369:0:14362:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789708804.340372:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789708804.340378:0:14362:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:01000000:0.0:1789708804.340406:0:14362:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789708804.340409:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789708804.340423:0:14362:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a143454cd40) 00000020:00000080:0.0:1789708804.340452:0:14362:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789708804.340459:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789708804.340514:0:14362:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789708804.340520:0:14362:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789708804.340527:0:14362:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa8f741d1c686717b 00010000:00080000:0.0:1789708804.340561:0:14362:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1423226800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:0.0:1789708804.341064:0:14362:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1789708804.341864:0:14362:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789708804.341918:0:14362:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789708804.352886:0:14362:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708804.352987:0:14362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789708804.353078:0:14362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789708804.353737:0:14366:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789708804.353743:0:14366:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789708804.356334:0:14362:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789708804.356354:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789708804.356400:0:14362:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789708804.356421:0:14362:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa8f741d1c6867182 00000100:00080000:0.0:1789708804.356432:0:14362:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789708804.356526:0:14362:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a1423226800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1789708804.356564:0:14362:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13082be300 x1876645426308736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789708804.358315:0:14362:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789708804.358551:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426308736:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789708804.358629:0:3285:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876645426308736 offset 0 length 520: 4 00000020:01000000:0.0:1789708804.359022:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708804.359033:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708804.359042:0:14362:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789708804.359048:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789708804.359051:0:14362:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1789708804.359053:0:14362:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789708804.359054:0:14362:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789708804.359056:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789708804.359058:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708804.359060:0:14362:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789708804.359063:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789708804.359067:0:14362:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789708804.359070:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708804.359072:0:14362:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789708804.359075:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789708804.359079:0:14362:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:01000000:0.0:1789708804.359303:0:14362:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789708804.359307:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789708804.359322:0:14362:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a1434548000) 00000020:00000080:0.0:1789708804.359340:0:14362:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789708804.359346:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789708804.359421:0:14362:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789708804.359428:0:14362:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789708804.359435:0:14362:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa8f741d1c6867190 00010000:00080000:0.0:1789708804.359545:0:14362:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1410605000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:1.0:1789708804.361324:0:14362:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789708804.361604:0:14362:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789708804.361629:0:14362:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789708804.366512:0:14362:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708804.366593:0:14362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789708804.366964:0:14362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1789708804.367406:0:14368:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789708804.367411:0:14368:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789708804.373198:0:14362:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789708804.373217:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789708804.373261:0:14362:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789708804.373284:0:14362:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa8f741d1c6867197 00000100:00080000:3.0:1789708804.373295:0:14362:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789708804.373307:0:14362:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a1410605000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1789708804.373343:0:14362:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a14344c1180 x1876645426308864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708804.373427:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426308864:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789708804.373490:0:3285:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876645426308864 offset 0 length 520: 4 00000100:00080000:3.0:1789708804.373546:0:14362:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789708804.373600:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708804.373604:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708804.373606:0:14362:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789708804.373608:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708804.373612:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708804.373613:0:14362:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789708804.373616:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789708804.373618:0:14362:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789708804.373620:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708804.373622:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708804.373623:0:14362:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789708804.373625:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708804.373628:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708804.373629:0:14362:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789708804.373632:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789708804.373689:0:14362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdca603d-b230-4a0c-9898-90b77d1d9d18:14362:1876645426308992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708804.373752:0:14362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708804.373781:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426308992 00000100:00100000:3.0:1789708804.373794:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426308992 00000100:00100000:3.0:1789708804.373843:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789708804.373852:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+9:14362:x1876645426308992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708804.374131:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+9:14362:x1876645426308992:12345-0@lo:502:llog_process_th.0 Request processed in 276us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708804.374142:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789708804.374182:0:14362:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1302c29f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789708804.374202:0:14362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdca603d-b230-4a0c-9898-90b77d1d9d18:14362:1876645426308992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789708804.374226:0:14362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708804.374230:0:14362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708804.374231:0:14362:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789708804.374235:0:14362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789708804.374297:0:14326:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1789708804.374329:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789708804.374352:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38c00/0xa8f741d1c6867120 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867127 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.374366:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa38c00/0xa8f741d1c6867120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867127 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708804.374376:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1306dcb000 from 1 10000000:01000000:3.0:1789708804.374380:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789708804.374413:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38e00/0xa8f741d1c686719e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.374422:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143fa38e00/0xa8f741d1c686719e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.374435:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143fa38e00/0xa8f741d1c686719e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708804.374464:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426309120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708804.374503:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708804.374527:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1302c29f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789708804.374562:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426309120 00000100:00100000:3.0:1789708804.374568:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426309120 00000100:00100000:3.0:1789708804.374601:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789708804.374609:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+9:14326:x1876645426309120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708804.374617:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708804.374631:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa38a00/0xa8f741d1c68671a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c686719e expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.374670:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa38a00/0xa8f741d1c68671a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c686719e expref: 10 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.374680:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa38a00/0xa8f741d1c68671a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686719e expref: 10 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.374688:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38a00, rc 0) 00000100:00100000:3.0:1789708804.374716:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+10:14326:x1876645426309120:12345-0@lo:101:mount.lustre.0 Request processed in 108us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708804.374722:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789708804.374755:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426309120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708804.374766:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143fa38e00/0xa8f741d1c686719e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68671a5 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.374774:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38e00/0xa8f741d1c686719e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c68671a5 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708804.375359:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426309248:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789708804.375396:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708804.375412:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1302c29f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789708804.375499:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426309248 00000100:00100000:3.0:1789708804.375504:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426309248 00000100:00100000:3.0:1789708804.375525:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789708804.375531:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+10:14326:x1876645426309248:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789708804.375545:0:14338:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789708804.375552:0:14338:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789708804.375619:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+10:14326:x1876645426309248:12345-0@lo:256:mount.lustre.0 Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708804.375626:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789708804.375682:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426309248:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789708804.381069:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789708804.381143:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38e00/0xa8f741d1c686719e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68671a5 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.381159:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa38e00/0xa8f741d1c686719e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68671a5 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708804.381168:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1306dcb000 from 1 10000000:01000000:3.0:1789708804.381171:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708804.381217:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38400/0xa8f741d1c68671ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.381226:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143fa38400/0xa8f741d1c68671ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.381247:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143fa38400/0xa8f741d1c68671ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708804.381275:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426309376:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708804.381349:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708804.381399:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1302c29f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708804.384533:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426309376 00000100:00100000:0.0:1789708804.384550:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426309376 00000100:00100000:0.0:1789708804.384619:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789708804.384630:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+10:14326:x1876645426309376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708804.384668:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708804.384704:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1426d23400/0xa8f741d1c68671b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c68671ac expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708804.384734:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1426d23400/0xa8f741d1c68671b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c68671ac expref: 11 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708804.384745:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1426d23400/0xa8f741d1c68671b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c68671ac expref: 11 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708804.384754:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23400, rc 0) 00000100:00100000:0.0:1789708804.384834:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+11:14326:x1876645426309376:12345-0@lo:101:mount.lustre.0 Request processed in 205us (3484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708804.384841:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789708804.384950:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426309376:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708804.384968:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143fa38400/0xa8f741d1c68671ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68671b3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708804.384987:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38400/0xa8f741d1c68671ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c68671b3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708804.385067:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426309504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708804.385112:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708804.385154:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14063246c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708804.385283:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426309504 00000100:00100000:3.0:1789708804.385289:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426309504 00000100:00100000:3.0:1789708804.385326:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789708804.385334:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+11:14326:x1876645426309504:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708804.385765:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+11:14326:x1876645426309504:12345-0@lo:501:mount.lustre.0 Request processed in 431us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708804.385773:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789708804.385937:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426309504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708804.385990:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426309632:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708804.386033:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708804.386053:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14063246c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708804.386118:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426309632 00000100:00100000:0.0:1789708804.386126:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426309632 00000100:00100000:0.0:1789708804.386159:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789708804.386167:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+11:14326:x1876645426309632:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789708804.386316:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+11:14326:x1876645426309632:12345-0@lo:503:mount.lustre.0 Request processed in 150us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708804.386323:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789708804.386408:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426309632:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708804.386888:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdca603d-b230-4a0c-9898-90b77d1d9d18:14370:1876645426309760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789708804.386928:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708804.386957:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1406324840 going to sleep for 11 seconds 00000100:00100000:3.0:1789708804.387030:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426309760 00000100:00100000:3.0:1789708804.387035:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426309760 00000100:00100000:3.0:1789708804.387068:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789708804.387076:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+11:14370:x1876645426309760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708804.387282:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+11:14370:x1876645426309760:12345-0@lo:502:llog_process_th.0 Request processed in 206us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708804.387290:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789708804.387338:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdca603d-b230-4a0c-9898-90b77d1d9d18:14370:1876645426309760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789708804.387361:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708804.387371:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708804.387375:0:14370:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789708804.387383:0:14370:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1306dcb000 00000020:00000080:3.0:1789708804.387389:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789708804.387397:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708804.387399:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708804.387400:0:14370:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789708804.387403:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708804.387405:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708804.387406:0:14370:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789708804.387409:0:14370:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1306dcb000 00000020:00000080:3.0:1789708804.387412:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789708804.387685:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708804.387690:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708804.387691:0:14370:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789708804.387694:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789708804.387697:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708804.387698:0:14370:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789708804.387702:0:14370:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1306dcb000 00000020:00000080:3.0:1789708804.387704:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789708804.394298:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdca603d-b230-4a0c-9898-90b77d1d9d18:14370:1876645426309888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708804.394406:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708804.394464:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426309888 00000100:00100000:3.0:1789708804.394473:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426309888 00000100:00100000:3.0:1789708804.394524:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789708804.394533:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+11:14370:x1876645426309888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708804.394788:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+11:14370:x1876645426309888:12345-0@lo:502:llog_process_th.0 Request processed in 255us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708804.394797:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789708804.394857:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1302c29b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708804.394878:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdca603d-b230-4a0c-9898-90b77d1d9d18:14370:1876645426309888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789708804.394907:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789708804.394914:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789708804.394922:0:14370:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789708804.394927:0:14370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789708804.411145:0:14326:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789708804.411195:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789708804.411224:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38400/0xa8f741d1c68671ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68671b3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708804.411239:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa38400/0xa8f741d1c68671ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68671b3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708804.411298:0:14326:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789708804.411306:0:14326:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a1306dcb000 10000000:01000000:0.0:1789708804.411309:0:14326:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a1306dcb000 10000000:01000000:0.0:1789708804.411314:0:14326:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789708804.411321:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1306dcb000 from 1 10000000:01000000:0.0:1789708804.411324:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789708804.411366:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1426d22000/0xa8f741d1c68671ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708804.411375:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1426d22000/0xa8f741d1c68671ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708804.411386:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1426d22000/0xa8f741d1c68671ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708804.411413:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426310016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789708804.411622:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708804.412066:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402f31d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708804.422615:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426310016 00000100:00100000:1.0:1789708804.422630:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426310016 00000100:00100000:1.0:1789708804.422716:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789708804.422727:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+11:14326:x1876645426310016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708804.422746:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708804.422765:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143efc5200/0xa8f741d1c68671c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c68671ba expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708804.422795:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143efc5200/0xa8f741d1c68671c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c68671ba expref: 12 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708804.422806:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143efc5200/0xa8f741d1c68671c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c68671ba expref: 12 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708804.422815:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5200, rc 0) 00000100:00100000:1.0:1789708804.422889:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:14326:x1876645426310016:12345-0@lo:101:mount.lustre.0 Request processed in 164us (11267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708804.422903:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789708804.423035:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426310016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708804.423054:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1426d22000/0xa8f741d1c68671ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68671c1 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708804.423063:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1426d22000/0xa8f741d1c68671ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c68671c1 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708804.423138:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426310144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708804.423175:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708804.423203:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402f31d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708804.423261:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426310144 00000100:00100000:1.0:1789708804.423266:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426310144 00000100:00100000:1.0:1789708804.423298:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789708804.423305:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:14326:x1876645426310144:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708804.423696:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:14326:x1876645426310144:12345-0@lo:501:mount.lustre.0 Request processed in 391us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708804.423704:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789708804.423792:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426310144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708804.423834:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426310272:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789708804.423879:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708804.423898:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402f31d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708804.426569:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426310272 00000100:00100000:1.0:1789708804.426583:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426310272 00000100:00100000:1.0:1789708804.426637:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789708804.426646:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:14326:x1876645426310272:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708804.426903:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:14326:x1876645426310272:12345-0@lo:503:mount.lustre.0 Request processed in 258us (3023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708804.426911:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789708804.429672:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426310272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708804.435777:0:14376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdca603d-b230-4a0c-9898-90b77d1d9d18:14376:1876645426310400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708804.435859:0:14376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708804.435905:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426310400 00000100:00100000:3.0:1789708804.435912:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426310400 00000100:00100000:3.0:1789708804.435956:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789708804.435965:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:14376:x1876645426310400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789708804.436234:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:14376:x1876645426310400:12345-0@lo:502:llog_process_th.0 Request processed in 269us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708804.436243:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789708804.436294:0:14376:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1302c29d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708804.436315:0:14376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdca603d-b230-4a0c-9898-90b77d1d9d18:14376:1876645426310400:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789708804.436375:0:14376:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789708804.436389:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a14344299c0) 00000020:00000080:3.0:1789708804.436408:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1789708804.436567:0:14376:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1306dcb000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789708804.436572:0:14376:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1306dcb000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789708804.436574:0:14376:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1306dcb000 4 00010000:00080000:3.0:1789708804.436607:0:14376:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a141354c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:2.0:1789708804.445382:0:14376:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1789708804.445731:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789708804.445777:0:14376:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789708804.445789:0:14376:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa8f741d1c68671cf 00000100:00080000:2.0:1789708804.445801:0:14376:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789708804.445813:0:14376:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a141354c000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1789708804.445850:0:14376:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a14344f1880 x1876645426310528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708804.445904:0:14376:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789708804.447691:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876645426310528:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789708804.447788:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708804.450931:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426310528 00000100:00100000:2.0:1789708804.450945:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426310528 00000100:00100000:2.0:1789708804.451008:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708804.451017:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1876645426310528:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789708804.451117:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1876645426310528:12345-0@lo:38:llog_process_th.0 Request processed in 100us (3328us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789708804.451125:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708804.451245:0:14376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdca603d-b230-4a0c-9898-90b77d1d9d18:14376:1876645426310656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789708804.451306:0:14376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708804.451335:0:14376:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1407603a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789708804.451889:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789708804.451898:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a141354c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708804.451902:0:3285:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789708804.451906:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876645426310528:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789708804.451934:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426310656 00000100:00100000:0.0:1789708804.451938:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426310656 00000100:00100000:0.0:1789708804.451992:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789708804.452000:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:14376:x1876645426310656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789708804.452275:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:14376:x1876645426310656:12345-0@lo:502:llog_process_th.0 Request processed in 275us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708804.452283:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789708804.452375:0:14376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cdca603d-b230-4a0c-9898-90b77d1d9d18:14376:1876645426310656:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789708804.452402:0:14376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789708804.460533:0:14326:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789708804.460580:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789708804.460611:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1426d22000/0xa8f741d1c68671ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68671c1 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708804.460624:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1426d22000/0xa8f741d1c68671ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68671c1 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789708804.460700:0:14326:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789708804.460703:0:14326:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789708804.460704:0:14326:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708804.460706:0:14326:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708804.460708:0:14326:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708804.460709:0:14326:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708804.460710:0:14326:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789708804.460712:0:14326:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789708804.460714:0:14326:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708804.460716:0:14326:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789708804.460719:0:14326:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789708804.460727:0:14326:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789708804.460728:0:14326:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789708804.460729:0:14326:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708804.460730:0:14326:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708804.460731:0:14326:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708804.460731:0:14326:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708804.460732:0:14326:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789708804.460733:0:14326:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789708804.460734:0:14326:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708804.460735:0:14326:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789708804.460993:0:14326:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789708804.461018:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426310784:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789708804.461101:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708804.461152:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1407603300 going to sleep for 11 seconds 00000100:00100000:0.0:1789708804.462613:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426310784 00000100:00100000:0.0:1789708804.462625:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426310784 00000100:00100000:0.0:1789708804.464053:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789708804.464071:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:14326:x1876645426310784:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789708804.464131:0:14337:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789708804.464146:0:14337:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789708804.511301:0:14337:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789708804.511321:0:14337:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789708804.511880:0:14360:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789708804.511885:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789708804.511909:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a143fa39800/0xa8f741d1c68671d6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.511927:0:14360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a143fa38a00/0xa8f741d1c68671a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686719e expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.511936:0:14360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a143fa39800/0xa8f741d1c68671d6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.511994:0:14360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a143fa38a00/0xa8f741d1c68671a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c686719e expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.512009:0:14360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a143fa38a00/0xa8f741d1c68671a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c686719e expref: 12 pid: 14337 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708804.512023:0:14360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14360:1876645426310912:0@lo:104: 00000100:00100000:3.0:1789708804.512105:0:14360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708804.512425:0:14360:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1302c293c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708804.512478:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426310912 00000100:00100000:3.0:1789708804.512485:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426310912 00000100:00100000:3.0:1789708804.512531:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708804.512543:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdca603d-b230-4a0c-9898-90b77d1d9d18+3:14360:x1876645426310912:12345-0@lo:104: 00010000:00010000:3.0:1789708804.512556:0:14327:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a143fa38e00/0xa8f741d1c686719e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c68671a5 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.512612:0:14327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789708804.512618:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdca603d-b230-4a0c-9898-90b77d1d9d18+3:14360:x1876645426310912:12345-0@lo:104: Request processed in 79us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708804.512626:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789708804.512670:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708804.512676:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a143fa38e00/0xa8f741d1c686719e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c68671a5 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.512684:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38e00 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:3.0:1789708804.512688:0:14333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa38e00/0xa8f741d1c686719e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c68671a5 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.512707:0:14333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a143fa38e00/0xa8f741d1c686719e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c68671a5 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708804.512714:0:14333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa38e00/0xa8f741d1c686719e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c68671a5 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708804.512720:0:14333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789708804.513513:0:14333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a143fa38e00/0xa8f741d1c686719e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c68671a5 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.513524:0:14333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708804.513559:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38e00/0xa8f741d1c686719e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c68671a5 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.513566:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a143fa38e00/0xa8f741d1c686719e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c68671a5 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.513587:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708804.513589:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708804.513591:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708804.513621:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789708804.513632:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdca603d-b230-4a0c-9898-90b77d1d9d18:3286:1876645426311040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789708804.513717:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708804.513982:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426311040 00000100:00100000:3.0:1789708804.513990:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426311040 00010000:00010000:3.0:1789708804.514018:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a143fa38a00/0xa8f741d1c68671a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c686719e expref: 13 pid: 14337 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708804.514046:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708804.514066:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdca603d-b230-4a0c-9898-90b77d1d9d18+13:3286:x1876645426311040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708804.514078:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708804.514085:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a143fa38a00/0xa8f741d1c68671a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c686719e expref: 13 pid: 14337 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.514095:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a143fa38a00/0xa8f741d1c68671a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c686719e expref: 13 pid: 14337 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.514113:0:14329:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a143fa39800/0xa8f741d1c68671d6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.514121:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa39800/0xa8f741d1c68671d6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789708804.514137:0:14329:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002252121s 00010000:00010000:3.0:1789708804.514142:0:14329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a143fa39800/0xa8f741d1c68671d6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.514371:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a143fa39800/0xa8f741d1c68671d6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.514378:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a143fa39800/0xa8f741d1c68671d6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.514385:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a143fa39800/0xa8f741d1c68671d6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.514391:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39800 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708804.514396:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a143fa39800/0xa8f741d1c68671d6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.514414:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a143fa39800/0xa8f741d1c68671d6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.514424:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a143fa39800/0xa8f741d1c68671d6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708804.514446:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708804.514485:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdca603d-b230-4a0c-9898-90b77d1d9d18+13:3286:x1876645426311040:12345-0@lo:103:ldlm_bl.0 Request processed in 421us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708804.514493:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708804.514534:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdca603d-b230-4a0c-9898-90b77d1d9d18:3286:1876645426311040:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708804.514633:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa38a00/0xa8f741d1c68671a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c686719e expref: 12 pid: 14337 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708804.514645:0:14360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14360:1876645426310912:0@lo:104: 00010000:00010000:2.0:1789708804.514689:0:14360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a143fa39800/0xa8f741d1c68671d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708804.514697:0:14360:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a143fa39800/0xa8f741d1c68671d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708804.514703:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a143fa39800/0xa8f741d1c68671d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708804.514709:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa39800/0xa8f741d1c68671d6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708804.529785:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+11:14326:x1876645426310784:12345-0@lo:253:mount.lustre.0 Request processed in 65712us (68674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708804.529810:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789708804.530116:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:14326:1876645426310784:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789708804.530132:0:14326:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789708804.530157:0:14326:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789708804.530159:0:14326:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789708804.530161:0:14326:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708804.530162:0:14326:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708804.530163:0:14326:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708804.530165:0:14326:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708804.530166:0:14326:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789708804.530168:0:14326:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789708804.530170:0:14326:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708804.530171:0:14326:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789708804.530201:0:14326:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789708804.538054:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789708804.541399:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789708804.541960:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789708804.542144:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789708804.542439:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789708804.542602:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789708804.544628:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789708804.545177:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789708804.545504:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789708804.545771:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789708804.546341:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789708804.554371:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1789708804.603297:0:14326:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1789708804.604154:0:14326:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789708804.604286:0:14383:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789708804.604291:0:14383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789708804.604857:0:14384:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1789708804.604984:0:14384:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708804.610338:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789708804.611814:0:14384:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789708804.611826:0:14384:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1789708804.615540:0:14326:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789708804.616402:0:14326:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789708804.618078:0:14326:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789708804.618103:0:14326:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789708804.619586:0:14326:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789708804.624223:0:14326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789708804.626297:0:14326:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789708804.626386:0:14326:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789708804.627176:0:14326:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1789708804.628349:0:14326:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1789708804.636638:0:14326:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789708804.693520:0:14326:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789708804.693569:0:14326:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa44901be3988 00100000:10000000:2.0:1789708804.693578:0:14326:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789708804.697937:0:14326:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789708804.697955:0:14326:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789708804.697980:0:14326:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1789708804.698008:0:14326:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789708804.988419:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789708805.435064:0:14375:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789708805.435074:0:14375:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789708805.435442:0:14375:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:3.0:1789708805.435456:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:3.0:1789708805.690987:0:14341:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789708805.690993:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1306dcb000 from 6 10000000:01000000:3.0:1789708805.690998:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789708805.691047:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa39600/0xa8f741d1c68671dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708805.691072:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143fa39600/0xa8f741d1c68671dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708805.691085:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143fa39600/0xa8f741d1c68671dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708805.691113:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426311168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708805.691184:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708805.691249:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140d44c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789708805.692350:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426311168 00000100:00100000:0.0:1789708805.692361:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426311168 00000100:00100000:0.0:1789708805.692432:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789708805.692443:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434667850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+11:14341:x1876645426311168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708805.692459:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708805.692475:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1426d23a00/0xa8f741d1c68671e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c68671dd expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708805.692502:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1426d23a00/0xa8f741d1c68671e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c68671dd expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708805.692515:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1426d23a00/0xa8f741d1c68671e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c68671dd expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708805.692524:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23a00, rc 0) 00000100:00100000:0.0:1789708805.692586:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434667850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:14341:x1876645426311168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708805.692593:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789708805.692644:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426311168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708805.692682:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143fa39600/0xa8f741d1c68671dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68671e4 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708805.692707:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143fa39600/0xa8f741d1c68671dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c68671e4 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708805.692765:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426311296:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789708805.692816:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708805.692832:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402ad3780 going to sleep for 11 seconds 00000100:00100000:1.0:1789708805.693566:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426311296 00000100:00100000:1.0:1789708805.693575:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426311296 00000100:00100000:1.0:1789708805.693614:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789708805.693622:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434666c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:14341:x1876645426311296:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789708805.693641:0:14339:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789708805.693682:0:14339:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789708805.693686:0:14339:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789708805.693786:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434666c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:14341:x1876645426311296:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 164us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708805.693794:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789708805.693838:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426311296:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789708805.693883:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789708805.693890:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa39600/0xa8f741d1c68671dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68671e4 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708805.693899:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa39600/0xa8f741d1c68671dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68671e4 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708806.011839:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789708806.459856:0:14375:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789708806.459865:0:14375:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789708806.463051:0:14375:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1789708806.463201:0:14375:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789708806.463241:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:2.0:1789708807.034988:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708808.063855:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708809.092287:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789708809.469853:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708809.469862:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789708809.469864:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708809.469868:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789708809.469870:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789708809.469874:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789708809.469877:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a141354c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789708809.469897:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a141354c000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1789708809.469921:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13082bdf80 x1876645426311552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708809.469993:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdca603d-b230-4a0c-9898-90b77d1d9d18:3288:1876645426311424:0@lo:400:kworker.0 00000100:00100000:0.0:1789708809.470070:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708809.470195:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876645426311552:0@lo:38:kworker.0 00000100:00100000:1.0:1789708809.470233:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708809.470278:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426311424 00000100:00100000:1.0:1789708809.470286:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426311424 00000100:00100000:1.0:1789708809.470326:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789708809.470334:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:3288:x1876645426311424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708809.470385:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:3288:x1876645426311424:12345-0@lo:400:kworker.0 Request processed in 50us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708809.470392:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789708809.470439:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdca603d-b230-4a0c-9898-90b77d1d9d18:3288:1876645426311424:0@lo:400:kworker.0 00000100:00100000:0.0:1789708809.470570:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426311552 00000100:00100000:0.0:1789708809.470575:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426311552 00000100:00100000:0.0:1789708809.470604:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708809.470609:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1876645426311552:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789708809.470632:0:14346:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 375 last 0 00000020:00000080:0.0:1789708809.470720:0:14346:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa8f741d1c68671eb 00000004:00100000:0.0:1789708809.470735:0:14346:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789708809.470872:0:14346:0:(import.c:65:import_set_state_nolock()) ffff8a1434bfb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789708809.470914:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876645426311552:12345-0@lo:38:kworker.0 Request processed in 303us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708809.470921:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789708809.471011:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a13082bdf80 x1876645426311552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789708809.471027:0:3285:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789708809.471035:0:3285:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789708809.471040:0:3285:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789708809.471043:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a141354c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789708809.471048:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876645426311552:0@lo:38:kworker.0 00000001:02000400:0.0:1789708809.507491:0:14628:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789708810.114747:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708811.151875:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708812.162184:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789708812.817111:0:14779:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9fb2af00 20000000:00000080:3.0:1789708812.817184:0:14779:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a143e607400 uarg=0000000000000000 20000000:01000000:3.0:1789708812.817224:0:14779:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789708812.817230:0:14779:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789708812.817234:0:14779:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789708812.817910:0:14780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1789708812.818081:0:14779:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789708812.823031:0:14779:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789708812.823062:0:14779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c68671f2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708812.823082:0:14779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1426d23400/0xa8f741d1c68671b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c68671ac expref: 11 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708812.823105:0:14779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c68671f2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708812.823155:0:14779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1426d23400/0xa8f741d1c68671b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c68671ac expref: 11 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708812.823166:0:14779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1426d23400/0xa8f741d1c68671b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c68671ac expref: 11 pid: 14338 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708812.823176:0:14779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14779:1876645426311680:0@lo:104: 00000100:00100000:3.0:1789708812.823229:0:14779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708812.823275:0:14779:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405102840 going to sleep for 11 seconds 00000100:00100000:1.0:1789708812.823365:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426311680 00000100:00100000:1.0:1789708812.823373:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426311680 00000100:00100000:1.0:1789708812.823426:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708812.823436:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdca603d-b230-4a0c-9898-90b77d1d9d18+3:14779:x1876645426311680:12345-0@lo:104: 00010000:00010000:1.0:1789708812.823449:0:14328:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a143fa38400/0xa8f741d1c68671ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c68671b3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708812.823526:0:14328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789708812.823532:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdca603d-b230-4a0c-9898-90b77d1d9d18+3:14779:x1876645426311680:12345-0@lo:104: Request processed in 98us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708812.823539:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789708812.823559:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708812.823563:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a143fa38400/0xa8f741d1c68671ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c68671b3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708812.823568:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38400 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:1.0:1789708812.823571:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa38400/0xa8f741d1c68671ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c68671b3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708812.823578:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a143fa38400/0xa8f741d1c68671ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c68671b3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708812.823583:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa38400/0xa8f741d1c68671ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c68671b3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708812.823586:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789708812.823609:0:14332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a143fa38400/0xa8f741d1c68671ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c68671b3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708812.823613:0:14332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789708812.823627:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38400/0xa8f741d1c68671ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c68671b3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708812.823631:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a143fa38400/0xa8f741d1c68671ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c68671b3 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708812.823676:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708812.823677:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708812.823678:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708812.823693:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdca603d-b230-4a0c-9898-90b77d1d9d18:3289:1876645426311808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708812.823714:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708812.823741:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426311808 00000100:00100000:1.0:1789708812.823743:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426311808 00010000:00010000:1.0:1789708812.823756:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1426d23400/0xa8f741d1c68671b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c68671ac expref: 12 pid: 14338 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708812.823771:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708812.823775:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:3289:x1876645426311808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708812.823782:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708812.823889:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1426d23400/0xa8f741d1c68671b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c68671ac expref: 12 pid: 14338 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708812.823907:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1426d23400/0xa8f741d1c68671b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c68671ac expref: 12 pid: 14338 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708812.823923:0:14329:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c68671f2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708812.823930:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c68671f2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708812.823944:0:14329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c68671f2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708812.823951:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c68671f2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708812.823964:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c68671f2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708812.823970:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c68671f2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708812.823975:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38e00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708812.823978:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c68671f2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708812.823985:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c68671f2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708812.823994:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c68671f2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708812.824004:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708812.824026:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:3289:x1876645426311808:12345-0@lo:103:ldlm_bl.0 Request processed in 251us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708812.824031:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708812.824058:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdca603d-b230-4a0c-9898-90b77d1d9d18:3289:1876645426311808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789708812.824145:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1426d23400/0xa8f741d1c68671b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c68671ac expref: 11 pid: 14338 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708812.824154:0:14779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14779:1876645426311680:0@lo:104: 00010000:00010000:2.0:1789708812.824164:0:14779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c68671f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708812.824170:0:14779:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c68671f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708812.824174:0:14779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c68671f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708812.824177:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c68671f2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708813.179751:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708814.203379:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789708814.271718:0:14341:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789708814.271730:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1306dcb000 from 10 10000000:01000000:0.0:1789708814.271737:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789708814.271801:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1426d23800/0xa8f741d1c68671f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708814.271814:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1426d23800/0xa8f741d1c68671f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708814.271826:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1426d23800/0xa8f741d1c68671f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708814.271856:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426311936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708814.272017:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708814.272280:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f632e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708814.272310:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426311936 00000100:00100000:0.0:1789708814.272319:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426311936 00000100:00100000:0.0:1789708814.272450:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789708814.272460:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+11:14341:x1876645426311936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708814.272475:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708814.272502:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1426d23c00/0xa8f741d1c6867200 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c68671f9 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708814.272528:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1426d23c00/0xa8f741d1c6867200 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c68671f9 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708814.272539:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1426d23c00/0xa8f741d1c6867200 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c68671f9 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708814.272548:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23c00, rc 0) 00000100:00100000:0.0:1789708814.272595:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:14341:x1876645426311936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708814.272602:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789708814.273615:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426311936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708814.273637:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1426d23800/0xa8f741d1c68671f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867200 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708814.273669:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1426d23800/0xa8f741d1c68671f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6867200 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708814.273738:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426312064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708814.273778:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708814.273809:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a143f632e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789708814.273822:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426312064 00000100:00100000:0.0:1789708814.273828:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426312064 00000100:00100000:0.0:1789708814.273858:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789708814.278273:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:14341:x1876645426312064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789708814.280505:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:14341:x1876645426312064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6628us (6714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708814.280528:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789708814.285220:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426312064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708814.285309:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426312192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708814.285388:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708814.285439:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140390da80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708814.285513:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426312192 00000100:00100000:3.0:1789708814.285521:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426312192 00000100:00100000:3.0:1789708814.285582:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789708814.285600:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:14341:x1876645426312192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708814.285838:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:14341:x1876645426312192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 247us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708814.285847:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789708814.285904:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426312192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789708814.291715:0:14840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789708814.291913:0:14341:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789708814.291944:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708814.291955:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1426d23800/0xa8f741d1c68671f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867200 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708814.291968:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1426d23800/0xa8f741d1c68671f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867200 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789708814.587679:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708814.587692:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789708814.587694:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708814.587698:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789708814.588523:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789708814.588561:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876645426312320:0@lo:400:kworker.0 00000100:00100000:1.0:1789708814.588641:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708814.590198:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426312320 00000100:00100000:2.0:1789708814.590212:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426312320 00000100:00100000:2.0:1789708814.590287:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708814.590298:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876645426312320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708814.590409:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876645426312320:12345-0@lo:400:kworker.0 Request processed in 113us (1767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708814.590417:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789708814.590470:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a13082bf480 x1876645426312320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708814.590486:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876645426312320:0@lo:400:kworker.0 00000100:00100000:0.0:1789708814.591302:0:3285:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708804/real 1789708804] req@ffff8a14344c1180 x1876645426308864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708814 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708814.591338:0:3285:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a14344c1180 x1876645426308864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708814 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708814.591349:0:3285:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708804/real 1789708804] req@ffff8a13082be300 x1876645426308736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708814 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708814.591362:0:3285:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a13082be300 x1876645426308736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708814 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789708814.591377:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a1410605000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708814.591403:0:3285:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789708814.591407:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426308864:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789708814.591412:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a1423226800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789708814.591417:0:3285:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789708814.591420:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426308736:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789708814.591471:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789708814.591476:0:485:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789708814.591479:0:485:0:(import.c:65:import_set_state_nolock()) ffff8a1423226800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789708814.591483:0:485:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 370 00000100:00080000:1.0:1789708814.591488:0:485:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789708814.591498:0:485:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a1423226800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1789708814.591529:0:485:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a143f4e4380 x1876645426312448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789708814.591555:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789708814.591558:0:485:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789708814.591560:0:485:0:(import.c:65:import_set_state_nolock()) ffff8a1410605000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789708814.591563:0:485:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 370 00000100:00080000:1.0:1789708814.591566:0:485:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789708814.591572:0:485:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a1410605000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1789708814.591584:0:485:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a143f4e6d80 x1876645426312576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708814.593206:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426312448:0@lo:8:kworker.0 00000400:00000100:0.0:1789708814.593298:0:3285:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876645426312448 offset 0 length 520: 4 00000100:00100000:0.0:1789708814.593359:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426312576:0@lo:8:kworker.0 00000400:00000100:0.0:1789708814.593377:0:3285:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876645426312576 offset 0 length 520: 4 00010000:00010000:1.0:1789708815.226964:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708816.259621:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789708816.700234:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789708817.274935:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789708818.132033:0:15028:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789708818.132037:0:15028:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789708818.134445:0:15028:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a1434bf8000 00000020:01000004:0.0:1789708818.134473:0:15028:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789708818.134487:0:15028:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789708818.135200:0:15028:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a143454b380) 00000020:00000080:0.0:1789708818.135228:0:15028:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789708818.189773:0:15028:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789708818.190243:0:15028:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789708818.191327:0:15028:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789708818.191761:0:15028:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789708818.192327:0:15028:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789708818.192946:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 207: rc = 0 00100000:10000000:2.0:1789708818.193151:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 207: rc = 0 00100000:10000000:2.0:1789708818.193302:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 207: rc = 0 00100000:10000000:2.0:1789708818.194164:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 768: rc = 0 00100000:10000000:2.0:1789708818.194409:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:2.0:1789708818.194927:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 768: rc = 0 00100000:10000000:2.0:1789708818.195261:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:2.0:1789708818.195599:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 768: rc = 0 00100000:10000000:2.0:1789708818.196231:0:15028:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 768: rc = 0 00000020:00000080:2.0:1789708818.197066:0:15028:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789708818.197078:0:15028:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789708818.197089:0:15028:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa8f741d1c686720e 00000020:01000004:2.0:1789708818.197098:0:15028:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789708818.197121:0:15028:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.153@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789708818.197124:0:15028:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789708818.197133:0:15028:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789708818.197138:0:15028:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789708818.197149:0:15028:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a1402f78000) 00000020:00000080:2.0:1789708818.197160:0:15028:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1789708818.199297:0:15028:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708818.199555:0:15028:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789708818.199563:0:15028:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789708818.207593:0:15028:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789708818.207731:0:15028:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789708818.208209:0:15028:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789708818.208216:0:15028:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789708818.211585:0:15028:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789708818.211935:0:15028:0:(service.c:3474:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789708818.211942:0:15028:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789708818.213748:0:15028:0:(service.c:3474:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789708818.213764:0:15028:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789708818.271551:0:15028:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708818.271829:0:15028:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789708818.271837:0:15028:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789708818.275911:0:15028:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789708818.275929:0:15028:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789708818.278231:0:15028:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789708818.278245:0:15028:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789708818.281266:0:15028:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789708818.281481:0:15028:0:(service.c:3474:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789708818.281488:0:15028:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789708818.285761:0:15028:0:(service.c:3474:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789708818.285775:0:15028:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:2.0:1789708818.298980:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708818.424018:0:15028:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789708818.424975:0:15028:0:(service.c:3474:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789708818.424986:0:15028:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789708818.430065:0:15028:0:(service.c:3474:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789708818.430082:0:15028:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789708818.431449:0:15028:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789708818.431478:0:15028:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789708818.431485:0:15028:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789708818.447549:0:15028:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789708818.447605:0:15028:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.153@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789708818.447611:0:15028:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789708818.447614:0:15028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789708818.447615:0:15028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708818.447616:0:15028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708818.447617:0:15028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708818.447618:0:15028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708818.447620:0:15028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789708818.447622:0:15028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708818.447624:0:15028:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789708818.447629:0:15028:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789708818.447632:0:15028:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789708818.447633:0:15028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789708818.447635:0:15028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708818.447636:0:15028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708818.447637:0:15028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708818.447638:0:15028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708818.447639:0:15028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789708818.447641:0:15028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708818.447641:0:15028:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789708818.447702:0:15028:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789708818.447726:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426312704:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789708818.449091:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708818.449227:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140800a240 going to sleep for 11 seconds 00000100:00100000:0.0:1789708818.456453:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426312704 00000100:00100000:0.0:1789708818.456469:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426312704 00000100:00100000:0.0:1789708818.456539:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789708818.456550:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:15028:x1876645426312704:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789708818.456589:0:14337:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789708818.456592:0:14337:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789708818.456596:0:14337:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789708818.477714:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:15028:x1876645426312704:12345-0@lo:253:mount.lustre.0 Request processed in 21157us (28619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708818.477733:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789708818.478077:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426312704:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789708818.478094:0:15028:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789708818.478097:0:15028:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789708818.478099:0:15028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789708818.478100:0:15028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708818.478101:0:15028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708818.478103:0:15028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708818.478104:0:15028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708818.478118:0:15028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789708818.478120:0:15028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708818.478121:0:15028:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789708818.478151:0:15028:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a1434bf8000 from lustre-OST0000 10000000:01000000:0.0:1789708818.478182:0:15028:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789708818.478185:0:15028:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789708818.478191:0:15028:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a14077019c0 local copy 00010000:00010000:0.0:1789708818.478201:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c6867104 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686710b expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708818.478505:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426312832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708818.478551:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708818.478643:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402ad3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708818.482470:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426312832 00000100:00100000:1.0:1789708818.482488:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426312832 00000100:00100000:1.0:1789708818.482615:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789708818.482629:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:15028:x1876645426312832:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708818.483186:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:15028:x1876645426312832:12345-0@lo:501:mount.lustre.0 Request processed in 558us (4631us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789708818.483207:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789708818.483353:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426312832:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789708818.483383:0:15028:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789708818.483564:0:15028:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789708818.483578:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c6867104 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686710b expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708818.483592:0:15028:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c6867104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686710b expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708818.483620:0:15028:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a1434bf8000 10000000:01000000:0.0:1789708818.483626:0:15028:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789708818.483632:0:15028:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8a14077019c0 10000000:01000000:0.0:1789708818.483635:0:15028:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789708818.483639:0:15028:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a14077019c0 from 1 10000000:01000000:0.0:1789708818.483642:0:15028:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789708818.483708:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1426d23200/0xa8f741d1c686721c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708818.483726:0:15028:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1426d23200/0xa8f741d1c686721c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708818.483736:0:15028:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1426d23200/0xa8f741d1c686721c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708818.483757:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426312960:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789708818.483809:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708818.488085:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402ad3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708818.488344:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426312960 00000100:00100000:3.0:1789708818.488356:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426312960 00000100:00100000:3.0:1789708818.488416:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789708818.488426:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+12:15028:x1876645426312960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708818.488445:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708818.488466:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa39a00/0xa8f741d1c6867223 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c686721c expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708818.488498:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa39a00/0xa8f741d1c6867223 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c686721c expref: 13 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708818.488511:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa39a00/0xa8f741d1c6867223 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686721c expref: 13 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708818.488522:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39a00, rc 0) 00000100:00100000:3.0:1789708818.488598:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+13:15028:x1876645426312960:12345-0@lo:101:mount.lustre.0 Request processed in 173us (4788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708818.488606:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789708818.488768:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426312960:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708818.488798:0:15028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1426d23200/0xa8f741d1c686721c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867223 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708818.488808:0:15028:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1426d23200/0xa8f741d1c686721c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6867223 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708818.488830:0:15028:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789708818.488853:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1426d23200/0xa8f741d1c686721c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867223 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708818.488861:0:15028:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1426d23200/0xa8f741d1c686721c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867223 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708818.488869:0:15028:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789708818.488874:0:15028:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789708818.488881:0:15028:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789708818.488883:0:15028:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789708818.488925:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1426d23400/0xa8f741d1c686722a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708818.488934:0:15028:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1426d23400/0xa8f741d1c686722a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708818.488942:0:15028:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1426d23400/0xa8f741d1c686722a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708818.488963:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426313088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789708818.488998:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708818.489023:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402ad3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789708818.489256:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426313088 00000100:00100000:3.0:1789708818.489268:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426313088 00000100:00100000:3.0:1789708818.489292:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789708818.489310:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+13:15028:x1876645426313088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708818.489321:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708818.489331:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa39400/0xa8f741d1c6867231 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c686722a expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708818.489347:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa39400/0xa8f741d1c6867231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c686722a expref: 14 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708818.489357:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa39400/0xa8f741d1c6867231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686722a expref: 14 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708818.489364:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39400, rc 0) 00000100:00100000:3.0:1789708818.489407:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+14:15028:x1876645426313088:12345-0@lo:101:mount.lustre.0 Request processed in 108us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708818.489414:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789708818.489555:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426313088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789708818.489566:0:15028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1426d23400/0xa8f741d1c686722a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867231 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708818.489574:0:15028:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1426d23400/0xa8f741d1c686722a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6867231 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789708818.490394:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789708818.491278:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789708818.491545:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789708818.491591:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789708818.491627:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789708818.491732:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789708818.491783:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789708818.491818:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789708818.491902:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789708818.491910:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789708818.492010:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426313216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708818.492081:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708818.492107:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140800c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708818.492533:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426313216 00000100:00100000:3.0:1789708818.492542:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426313216 00000100:00100000:3.0:1789708818.492585:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789708818.492594:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+14:15028:x1876645426313216:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708818.493041:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+14:15028:x1876645426313216:12345-0@lo:501:mount.lustre.0 Request processed in 447us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708818.493049:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789708818.495915:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426313216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708818.496280:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426313344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789708818.496500:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708818.496583:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140800c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708818.496667:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426313344 00000100:00100000:2.0:1789708818.496675:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426313344 00000100:00100000:3.0:1789708818.496832:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789708818.496854:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+14:15028:x1876645426313344:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708818.497593:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+14:15028:x1876645426313344:12345-0@lo:503:mount.lustre.0 Request processed in 749us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708818.497611:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789708818.498140:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426313344:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789708818.500102:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789708818.500200:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426313472:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708818.500277:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708818.500579:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426313472 00000100:00100000:3.0:1789708818.500588:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426313472 00000100:00100000:3.0:1789708818.500643:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789708818.500669:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+14:15028:x1876645426313472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708818.501094:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140800c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708818.501473:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+14:15028:x1876645426313472:12345-0@lo:502:mount.lustre.0 Request processed in 820us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708818.501483:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789708818.501935:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426313472:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789708818.502396:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789708818.502459:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789708818.502495:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789708818.502574:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789708818.502619:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789708818.507174:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789708818.507280:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789708818.507462:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789708818.507500:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1789708818.507578:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1789708818.507630:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1789708818.508460:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1789708818.508520:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426313600:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708818.508610:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708818.509434:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426313600 00000100:00100000:2.0:1789708818.509445:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426313600 00000100:00100000:2.0:1789708818.509510:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789708818.509520:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+14:15028:x1876645426313600:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708818.509992:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+14:15028:x1876645426313600:12345-0@lo:502:mount.lustre.0 Request processed in 265us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708818.510009:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789708818.510132:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140800c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708818.510158:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426313600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789708818.510263:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1789708818.510275:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1789708818.511565:0:15042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789708818.511575:0:15042:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1789708818.511582:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708818.511585:0:15042:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789708818.511591:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789708818.511607:0:15042:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a14345499c0) 00000020:00000080:0.0:1789708818.511629:0:15042:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789708818.511636:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789708818.511734:0:15042:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1434bf8000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789708818.511743:0:15042:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789708818.511750:0:15042:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa8f741d1c686723f 00010000:00010000:0.0:1789708818.515834:0:15042:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1789708818.516491:0:15042:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1789708818.518573:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789708818.521199:0:15042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789708818.521213:0:15042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708818.521221:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708818.521223:0:15042:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789708818.521228:0:15042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789708818.521230:0:15042:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1789708818.521232:0:15042:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789708818.521233:0:15042:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789708818.521235:0:15042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789708818.521238:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708818.521239:0:15042:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789708818.521242:0:15042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708818.521245:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708818.521246:0:15042:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789708818.521249:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789708818.521252:0:15042:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789708818.521254:0:15042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708818.521256:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708818.521258:0:15042:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789708818.521262:0:15042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789708818.521263:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708818.521264:0:15042:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789708818.521267:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789708818.521339:0:15042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789708818.521343:0:15042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708818.521344:0:15042:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789708818.521347:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1789708818.521578:0:15028:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789708818.521616:0:15028:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789708818.521641:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1426d23400/0xa8f741d1c686722a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867231 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708818.521694:0:15028:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1426d23400/0xa8f741d1c686722a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867231 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708818.521703:0:15028:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1434bf8000 from 1 10000000:01000000:0.0:1789708818.521706:0:15028:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789708818.521744:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1426d23600/0xa8f741d1c6867246 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708818.521752:0:15028:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1426d23600/0xa8f741d1c6867246 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708818.521775:0:15028:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1426d23600/0xa8f741d1c6867246 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708818.521800:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426313728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789708818.521876:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708818.521912:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140800cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789708818.523446:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426313728 00000100:00100000:1.0:1789708818.523458:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426313728 00000100:00100000:1.0:1789708818.523515:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789708818.523549:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+14:15028:x1876645426313728:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789708818.523566:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708818.523582:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143efc4e00/0xa8f741d1c686724d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6867246 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.523609:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143efc4e00/0xa8f741d1c686724d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6867246 expref: 15 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.523619:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143efc4e00/0xa8f741d1c686724d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6867246 expref: 15 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.523627:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4e00, rc 0) 00000100:00100000:1.0:1789708818.523720:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+15:15028:x1876645426313728:12345-0@lo:101:mount.lustre.0 Request processed in 172us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708818.523727:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789708818.523832:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426313728:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708818.523860:0:15028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1426d23600/0xa8f741d1c6867246 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686724d expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708818.523869:0:15028:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1426d23600/0xa8f741d1c6867246 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c686724d expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708818.524435:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789708818.525313:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708818.525563:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789708818.525608:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789708818.525703:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789708818.525712:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789708818.525801:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426313856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708818.525875:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708818.525909:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1408624180 going to sleep for 11 seconds 00000100:00100000:0.0:1789708818.526106:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426313856 00000100:00100000:0.0:1789708818.526114:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426313856 00000100:00100000:0.0:1789708818.526161:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789708818.526169:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+15:15028:x1876645426313856:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708818.526374:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+15:15028:x1876645426313856:12345-0@lo:501:mount.lustre.0 Request processed in 206us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708818.526381:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789708818.529531:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426313856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708818.529613:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426313984:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789708818.529719:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708818.529761:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1408624180 going to sleep for 11 seconds 00000100:00100000:2.0:1789708818.535444:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426313984 00000100:00100000:2.0:1789708818.535461:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426313984 00000100:00100000:2.0:1789708818.535524:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789708818.535531:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+15:15028:x1876645426313984:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789708818.535856:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+15:15028:x1876645426313984:12345-0@lo:503:mount.lustre.0 Request processed in 324us (6136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708818.535866:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789708818.539327:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426313984:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789708818.539972:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789708818.540082:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426314112:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708818.540160:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708818.540205:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789708818.540607:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426314112 00000100:00100000:1.0:1789708818.540614:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426314112 00000100:00100000:1.0:1789708818.540684:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789708818.540694:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+15:15028:x1876645426314112:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708818.540917:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+15:15028:x1876645426314112:12345-0@lo:502:mount.lustre.0 Request processed in 223us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708818.540924:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789708818.541044:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426314112:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789708818.541279:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789708818.541416:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789708818.541488:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789708818.541531:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789708818.541565:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789708818.541629:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789708818.541703:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789708818.541742:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1789708818.541775:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426314240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708818.541822:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708818.541863:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140800ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708818.541936:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426314240 00000100:00100000:2.0:1789708818.541943:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426314240 00000100:00100000:2.0:1789708818.541982:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789708818.541990:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+15:15028:x1876645426314240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708818.542142:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+15:15028:x1876645426314240:12345-0@lo:502:mount.lustre.0 Request processed in 153us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708818.542149:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789708818.543496:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426314240:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789708818.543632:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789708818.543644:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789708818.545754:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708818.545769:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708818.545771:0:15046:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789708818.545779:0:15046:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1434bf8000 00000020:00000080:0.0:1789708818.545782:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789708818.545790:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708818.545793:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708818.545795:0:15046:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789708818.545797:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708818.545800:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708818.545801:0:15046:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789708818.545805:0:15046:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1434bf8000 00000020:00000080:0.0:1789708818.545807:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789708818.545871:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708818.545876:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708818.545877:0:15046:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789708818.545880:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708818.545883:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708818.545884:0:15046:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789708818.545888:0:15046:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1434bf8000 00000020:00000080:0.0:1789708818.545890:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789708818.545928:0:15046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708818.545931:0:15046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708818.545932:0:15046:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789708818.545935:0:15046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789708818.555527:0:15028:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789708818.555580:0:15028:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789708818.555608:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1426d23600/0xa8f741d1c6867246 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686724d expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708818.555621:0:15028:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1426d23600/0xa8f741d1c6867246 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686724d expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708818.555705:0:15028:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789708818.555709:0:15028:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a1434bf8000 10000000:01000000:2.0:1789708818.555711:0:15028:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a1434bf8000 10000000:01000000:2.0:1789708818.555716:0:15028:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789708818.555722:0:15028:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1434bf8000 from 1 10000000:01000000:2.0:1789708818.555725:0:15028:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789708818.555765:0:15028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6867254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708818.555772:0:15028:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6867254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708818.555783:0:15028:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6867254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708818.555806:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426314368:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789708818.555880:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708818.555919:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426314368 00000100:00100000:2.0:1789708818.555926:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426314368 00000100:00100000:2.0:1789708818.555971:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789708818.555979:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+15:15028:x1876645426314368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708818.555992:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708818.556004:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1403b6b000/0xa8f741d1c686725b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6867254 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708818.556028:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1403b6b000/0xa8f741d1c686725b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6867254 expref: 16 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708818.556048:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1403b6b000/0xa8f741d1c686725b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6867254 expref: 16 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708818.556057:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6b000, rc 0) 00000100:00100000:2.0:1789708818.556088:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:15028:x1876645426314368:12345-0@lo:101:mount.lustre.0 Request processed in 109us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708818.556094:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789708818.556133:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708818.556153:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426314368:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708818.556166:0:15028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6867254 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686725b expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708818.556174:0:15028:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6867254 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c686725b expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789708818.556871:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789708818.557216:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789708818.561754:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789708818.561865:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789708818.561905:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789708818.561957:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789708818.561995:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789708818.562049:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789708818.562087:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789708818.562129:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789708818.562194:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789708818.562228:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789708818.562263:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789708818.564140:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789708818.564207:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789708818.564242:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789708818.564293:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789708818.565464:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789708818.565506:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789708818.565566:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789708818.565606:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789708818.565643:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789708818.565774:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789708818.565813:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789708818.565860:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789708818.565915:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789708818.565976:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789708818.567584:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789708818.567679:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789708818.567721:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789708818.567818:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789708818.567825:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789708818.570406:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426314496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708818.570488:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708818.570546:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708818.570677:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426314496 00000100:00100000:0.0:1789708818.570687:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426314496 00000100:00100000:0.0:1789708818.570739:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789708818.570749:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:15028:x1876645426314496:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708818.571094:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:15028:x1876645426314496:12345-0@lo:501:mount.lustre.0 Request processed in 346us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708818.571108:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789708818.571515:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426314496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708818.571569:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426314624:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789708818.571610:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708818.571643:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708818.571755:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426314624 00000100:00100000:0.0:1789708818.571760:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426314624 00000100:00100000:0.0:1789708818.571793:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789708818.571800:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:15028:x1876645426314624:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789708818.572062:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:15028:x1876645426314624:12345-0@lo:503:mount.lustre.0 Request processed in 260us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708818.572070:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789708818.574027:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426314624:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789708818.574789:0:15028:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789708818.574896:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426314752:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708818.574976:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708818.575501:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426314752 00000100:00100000:2.0:1789708818.575508:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426314752 00000100:00100000:2.0:1789708818.575557:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789708818.575566:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:15028:x1876645426314752:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708818.575912:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:15028:x1876645426314752:12345-0@lo:502:mount.lustre.0 Request processed in 346us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708818.575920:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789708818.575971:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789708818.577507:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426314752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789708818.577861:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789708818.577924:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789708818.577959:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789708818.579493:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789708818.579562:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789708818.579617:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789708818.579674:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789708818.579713:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789708818.579775:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789708818.579805:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789708818.579830:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789708818.579888:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789708818.579917:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789708818.579945:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789708818.579983:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789708818.580014:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789708818.580043:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789708818.580107:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789708818.580143:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789708818.580184:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789708818.580232:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789708818.580266:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789708818.580297:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789708818.581086:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789708818.581143:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789708818.581179:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789708818.581228:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789708818.581260:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789708818.581290:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789708818.581504:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789708818.581541:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789708818.581577:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789708818.581611:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789708818.581728:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789708818.581768:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789708818.581818:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789708818.581869:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789708818.581903:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789708818.581952:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789708818.582074:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789708818.582139:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426314880:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708818.582220:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708818.587507:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140307ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789708818.589037:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426314880 00000100:00100000:0.0:1789708818.589053:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426314880 00000100:00100000:0.0:1789708818.589150:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789708818.589162:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:15028:x1876645426314880:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708818.589558:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:15028:x1876645426314880:12345-0@lo:502:mount.lustre.0 Request processed in 399us (7337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708818.589567:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789708818.591523:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426314880:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789708818.591696:0:15028:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789708818.591713:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789708818.602631:0:15051:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789708818.602675:0:15051:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a1402f7b380) 00000020:00000080:2.0:1789708818.602702:0:15051:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1789708818.602789:0:15051:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1434bf8000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789708818.602793:0:15051:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1434bf8000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789708818.602797:0:15051:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1434bf8000 3 00010000:00080000:2.0:1789708818.602825:0:15051:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1404161000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.153@tcp at head 00010000:00010000:2.0:1789708818.605890:0:15051:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1789708818.606091:0:15051:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789708818.606131:0:15051:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789708818.606144:0:15051:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa8f741d1c6867269 00000100:00080000:2.0:1789708818.606154:0:15051:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789708818.606165:0:15051:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a1404161000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1789708818.606198:0:15051:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a14344f3800 x1876645426315008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708818.606230:0:15051:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789708818.606334:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1876645426315008:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789708818.606401:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789708818.606596:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708818.606602:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789708818.606605:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708818.606607:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789708818.606674:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876645426315136:0@lo:400:kworker.0 00000100:00100000:3.0:1789708818.621136:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708818.621227:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426315008 00000100:00100000:3.0:1789708818.621239:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426315008 00000100:00100000:3.0:1789708818.621267:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426315136 00000100:00100000:3.0:1789708818.621269:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426315136 00000100:00100000:3.0:1789708818.621294:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708818.621395:0:14344:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789708818.621406:0:14344:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789708818.621420:0:14346:0:(service.c:3474:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789708818.621430:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708818.621436:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1876645426315008:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789708818.621465:0:14346:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:1.0:1789708818.621513:0:14346:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa8f741d1c6867270 00000004:00100000:1.0:1789708818.621529:0:14346:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789708818.621573:0:14346:0:(import.c:65:import_set_state_nolock()) ffff8a1308a9f000 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1789708818.623296:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1789708818.623896:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876645426315008:12345-0@lo:38:llog_process_th.0 Request processed in 2454us (17489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708818.623910:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708818.624422:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876645426315136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708818.624481:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876645426315136:12345-0@lo:400:kworker.0 Request processed in 3178us (3350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708818.624489:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789708818.624544:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a13082bd180 x1876645426315136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708818.624560:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876645426315136:0@lo:400:kworker.0 00010000:00080000:3.0:1789708818.625747:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a14344f3800 x1876645426315008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708818.625759:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789708818.625767:0:3285:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789708818.625775:0:3285:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789708818.625780:0:3285:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789708818.625794:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a1404161000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789708818.625801:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1876645426315008:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1789708818.625897:0:15028:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789708818.625935:0:15028:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789708818.625959:0:15028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6867254 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686725b expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708818.625982:0:15028:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1403b6b600/0xa8f741d1c6867254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686725b expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789708818.626034:0:15028:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789708818.626037:0:15028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789708818.626038:0:15028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708818.626040:0:15028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708818.626041:0:15028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708818.626043:0:15028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708818.626044:0:15028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789708818.626046:0:15028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708818.626047:0:15028:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789708818.626051:0:15028:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789708818.626054:0:15028:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789708818.626055:0:15028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789708818.626056:0:15028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708818.626057:0:15028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708818.626058:0:15028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708818.626059:0:15028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708818.626060:0:15028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789708818.626061:0:15028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708818.626063:0:15028:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789708818.626095:0:15028:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789708818.626113:0:15028:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426315264:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789708818.626177:0:15028:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708818.626210:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426315264 00000100:00100000:0.0:1789708818.626217:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426315264 00000100:00100000:0.0:1789708818.626256:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789708818.626264:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:15028:x1876645426315264:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789708818.626297:0:14338:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789708818.626750:0:14338:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789708818.627142:0:15028:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140800a240 going to sleep for 11 seconds 20000000:01000000:2.0:1789708818.653789:0:14338:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789708818.653808:0:14338:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789708818.653979:0:14360:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789708818.653985:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789708818.654008:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6867277 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708818.654027:0:14360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1426d23a00/0xa8f741d1c68671e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c68671dd expref: 16 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708818.654036:0:14360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6867277 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708818.654079:0:14360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1426d23a00/0xa8f741d1c68671e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c68671dd expref: 16 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708818.654092:0:14360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1426d23a00/0xa8f741d1c68671e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c68671dd expref: 16 pid: 14338 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708818.654108:0:14360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14360:1876645426315392:0@lo:104: 00000100:00100000:3.0:1789708818.654172:0:14360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708818.654218:0:14360:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1404e83600 going to sleep for 11 seconds 00000100:00100000:2.0:1789708818.654276:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426315392 00000100:00100000:2.0:1789708818.654283:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426315392 00000100:00100000:2.0:1789708818.654334:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789708818.654341:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdca603d-b230-4a0c-9898-90b77d1d9d18+3:14360:x1876645426315392:12345-0@lo:104: 00010000:00010000:2.0:1789708818.654354:0:14328:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a143fa39600/0xa8f741d1c68671dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c68671e4 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708818.654399:0:14328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789708818.654404:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cdca603d-b230-4a0c-9898-90b77d1d9d18+3:14360:x1876645426315392:12345-0@lo:104: Request processed in 64us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708818.654411:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708818.654540:0:14360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14360:1876645426315392:0@lo:104: 00010000:00010000:3.0:1789708818.654557:0:14360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6867277 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.655124:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708818.655132:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a143fa39600/0xa8f741d1c68671dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c68671e4 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.655141:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39600 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:1.0:1789708818.655145:0:14333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa39600/0xa8f741d1c68671dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c68671e4 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.655153:0:14333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a143fa39600/0xa8f741d1c68671dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c68671e4 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789708818.655159:0:14333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa39600/0xa8f741d1c68671dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c68671e4 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789708818.655165:0:14333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789708818.655206:0:14333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a143fa39600/0xa8f741d1c68671dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c68671e4 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.655213:0:14333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789708818.655239:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a143fa39600/0xa8f741d1c68671dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c68671e4 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.655246:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a143fa39600/0xa8f741d1c68671dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c68671e4 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.655279:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708818.655281:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708818.655282:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708818.655295:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789708818.655318:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdca603d-b230-4a0c-9898-90b77d1d9d18:3289:1876645426315520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789708818.655356:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708818.655399:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426315520 00000100:00100000:1.0:1789708818.655404:0:14331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426315520 00010000:00010000:1.0:1789708818.655425:0:14331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1426d23a00/0xa8f741d1c68671e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c68671dd expref: 17 pid: 14338 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708818.655448:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708818.655455:0:14331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdca603d-b230-4a0c-9898-90b77d1d9d18+17:3289:x1876645426315520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708818.655468:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708818.655472:0:14331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1426d23a00/0xa8f741d1c68671e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c68671dd expref: 17 pid: 14338 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.655482:0:14331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1426d23a00/0xa8f741d1c68671e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c68671dd expref: 17 pid: 14338 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.655498:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1426d23a00/0xa8f741d1c68671e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c68671dd expref: 17 pid: 14338 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.655513:0:14331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6867277 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.655522:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6867277 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789708818.655549:0:14331:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002252121s 00010000:00010000:1.0:1789708818.655554:0:14331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6867277 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.655562:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6867277 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.655570:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6867277 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.655577:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6867277 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.659320:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39200 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708818.659327:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6867277 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.659338:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6867277 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.659362:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6867277 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.659379:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708818.659464:0:14331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:3289:x1876645426315520:12345-0@lo:103:ldlm_bl.0 Request processed in 4005us (4102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708818.659476:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708818.659542:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdca603d-b230-4a0c-9898-90b77d1d9d18:3289:1876645426315520:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708818.659572:0:14360:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6867277 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.659766:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6867277 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708818.659773:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6867277 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708818.689904:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+15:15028:x1876645426315264:12345-0@lo:253:mount.lustre.0 Request processed in 63630us (63717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708818.689922:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789708818.690861:0:15028:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15028:1876645426315264:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789708818.690891:0:15028:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789708818.690895:0:15028:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789708818.690896:0:15028:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789708818.690897:0:15028:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789708818.690899:0:15028:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789708818.690900:0:15028:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789708818.690901:0:15028:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789708818.690903:0:15028:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789708818.690904:0:15028:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789708818.690906:0:15028:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789708818.690935:0:15028:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789708818.702058:0:15028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789708818.702316:0:15028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789708818.702476:0:15028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789708818.702633:0:15028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789708818.702825:0:15028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789708818.703058:0:15028:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789708818.704322:0:15028:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789708818.762380:0:15028:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789708818.762389:0:15028:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789708818.762422:0:15028:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789708818.762481:0:15028:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789708818.762499:0:15028:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789708818.762529:0:15028:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789708819.323532:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789708820.090886:0:14341:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789708820.090897:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1306dcb000 from 7 10000000:01000000:3.0:1789708820.090904:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789708820.090960:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c686727e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708820.090973:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c686727e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708820.090985:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c686727e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708820.091016:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426315648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708820.091102:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708820.091161:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14349e5540 going to sleep for 11 seconds 00000100:00100000:0.0:1789708820.095076:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426315648 00000100:00100000:0.0:1789708820.095094:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426315648 00000100:00100000:0.0:1789708820.095167:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789708820.095177:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+15:14341:x1876645426315648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789708820.095199:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708820.095226:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1426d23e00/0xa8f741d1c6867285 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c686727e expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708820.095258:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1426d23e00/0xa8f741d1c6867285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c686727e expref: 16 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708820.095300:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1426d23e00/0xa8f741d1c6867285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686727e expref: 16 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708820.095333:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1426d23e00, rc 0) 00000100:00100000:0.0:1789708820.095425:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:14341:x1876645426315648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 249us (4323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708820.095432:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789708820.096096:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426315648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708820.096119:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c686727e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867285 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708820.096130:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c686727e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6867285 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708820.096203:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426315776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789708820.096251:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708820.096315:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14349e5540 going to sleep for 11 seconds 00000100:00100000:2.0:1789708820.096357:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426315776 00000100:00100000:2.0:1789708820.096363:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426315776 00000100:00100000:2.0:1789708820.096414:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789708820.096423:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:14341:x1876645426315776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789708820.096441:0:14338:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789708820.096463:0:14338:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789708820.096466:0:14338:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789708820.096552:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:14341:x1876645426315776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708820.096560:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789708820.096705:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426315776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789708820.096761:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789708820.096769:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c686727e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867285 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708820.096777:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c686727e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867285 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708820.347865:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708821.374395:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708822.394921:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708823.419899:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789708823.804710:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789708823.804718:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789708823.804722:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789708823.804725:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789708823.804777:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789708823.804809:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdca603d-b230-4a0c-9898-90b77d1d9d18:3288:1876645426315904:0@lo:400:kworker.0 00000100:00100000:1.0:1789708823.804890:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708823.804957:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426316032:0@lo:400:kworker.0 00000100:00100000:1.0:1789708823.804990:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708823.805012:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708823.805017:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426316160:0@lo:400:kworker.0 00000100:00100000:1.0:1789708823.805045:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708823.805080:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426315904 00000100:00100000:1.0:1789708823.805088:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426315904 00000100:00100000:1.0:1789708823.805142:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789708823.805152:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:3288:x1876645426315904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708823.805360:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:3288:x1876645426315904:12345-0@lo:400:kworker.0 Request processed in 208us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708823.805369:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789708823.805411:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426316032 00000100:00100000:1.0:1789708823.805415:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426316032 00000100:00100000:1.0:1789708823.805442:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426316160 00000100:00100000:1.0:1789708823.805444:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426316160 00000100:00100000:1.0:1789708823.805479:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708823.805486:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426316032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708823.805528:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426316032:12345-0@lo:400:kworker.0 Request processed in 44us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708823.805535:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708823.805549:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789708823.805558:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426316160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708823.805588:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426316160:12345-0@lo:400:kworker.0 Request processed in 32us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708823.805642:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789708823.805722:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789708823.805754:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a143f4e7100 x1876645426316160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708823.805770:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426316160:0@lo:400:kworker.0 00010000:00080000:1.0:1789708823.805784:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a143f4e5c00 x1876645426316032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789708823.805804:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426316032:0@lo:400:kworker.0 00000100:00100000:1.0:1789708823.805843:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdca603d-b230-4a0c-9898-90b77d1d9d18:3288:1876645426315904:0@lo:400:kworker.0 00010000:00010000:1.0:1789708824.442889:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789708824.952878:0:15396:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789708825.466809:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708826.500356:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789708826.939335:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789708827.515532:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708828.538858:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789708828.922881:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708828.922887:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789708828.922889:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708828.922891:0:485:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789708828.922926:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876645426316416:0@lo:400:kworker.0 00000100:00100000:2.0:1789708828.923001:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708828.923053:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789708828.923059:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdca603d-b230-4a0c-9898-90b77d1d9d18:3289:1876645426316288:0@lo:400:kworker.0 00000100:00100000:2.0:1789708828.923082:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708828.923105:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426316544:0@lo:400:kworker.0 00000100:00100000:2.0:1789708828.923123:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708828.923147:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426316416 00000100:00100000:2.0:1789708828.923152:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426316416 00000100:00100000:2.0:1789708828.923185:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426316544 00000100:00100000:2.0:1789708828.923186:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426316544 00000100:00100000:2.0:1789708828.923209:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789708828.923225:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876645426316416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708828.923275:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876645426316416:12345-0@lo:400:kworker.0 Request processed in 52us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708828.923280:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789708828.923295:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789708828.923299:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426316544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708828.923321:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876645426316544:12345-0@lo:400:kworker.0 Request processed in 22us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708828.923324:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789708828.923336:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426316288 00000100:00100000:2.0:1789708828.923338:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426316288 00000100:00100000:2.0:1789708828.923354:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789708828.923357:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:3289:x1876645426316288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708828.923374:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:3289:x1876645426316288:12345-0@lo:400:kworker.0 Request processed in 16us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708828.923377:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1789708828.923397:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789708828.923427:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a14344f3480 x1876645426316544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708828.923439:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1876645426316544:0@lo:400:kworker.0 00000100:00100000:2.0:1789708828.923458:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdca603d-b230-4a0c-9898-90b77d1d9d18:3289:1876645426316288:0@lo:400:kworker.0 00010000:00080000:2.0:1789708828.923467:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a14344f2300 x1876645426316416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708828.923475:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876645426316416:0@lo:400:kworker.0 00010000:00010000:3.0:1789708829.563508:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708829.882853:0:3285:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708814/real 1789708814] req@ffff8a143f4e4380 x1876645426312448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708829 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708829.882889:0:3285:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a143f4e4380 x1876645426312448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708829 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708829.882899:0:3285:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789708814/real 1789708814] req@ffff8a143f4e6d80 x1876645426312576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708829 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708829.882910:0:3285:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a143f4e6d80 x1876645426312576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789708829 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789708829.882932:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a1423226800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789708829.882953:0:3285:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789708829.882957:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426312448:0@lo:8:kworker.0 00000100:00080000:3.0:1789708829.882964:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a1410605000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789708829.882970:0:3285:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789708829.882982:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426312576:0@lo:8:kworker.0 00000100:00080000:0.0:1789708829.883141:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708829.883146:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789708829.883149:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a1423226800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789708829.883153:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 380 00000100:00080000:0.0:1789708829.883160:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789708829.883170:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a1423226800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1789708829.883190:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13082bd880 x1876645426316800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789708829.883202:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789708829.883206:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789708829.883207:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a1410605000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789708829.883210:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 380 00000100:00080000:0.0:1789708829.883213:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789708829.883217:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a1410605000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1789708829.883228:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13082bf800 x1876645426316928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789708829.883270:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789708829.883283:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdca603d-b230-4a0c-9898-90b77d1d9d18:3286:1876645426316672:0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.883343:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708829.883402:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876645426317184:0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.883433:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708829.883455:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789708829.883460:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876645426317056:0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.883494:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708829.883524:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426317184 00000100:00100000:0.0:1789708829.883542:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426317184 00000100:00100000:0.0:1789708829.883582:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426317056 00000100:00100000:0.0:1789708829.883585:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426317056 00000100:00100000:0.0:1789708829.883606:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789708829.883614:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876645426317184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708829.883771:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426316672 00000100:00100000:1.0:1789708829.883778:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426316672 00000100:00100000:1.0:1789708829.883817:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789708829.883824:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:3286:x1876645426316672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708829.883862:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:3286:x1876645426316672:12345-0@lo:400:kworker.0 Request processed in 39us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708829.883869:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789708829.883913:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdca603d-b230-4a0c-9898-90b77d1d9d18:3286:1876645426316672:0@lo:400:kworker.0 00000100:00100000:3.0:1789708829.884059:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426316800:0@lo:8:kworker.0 00000100:00100000:3.0:1789708829.884094:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708829.884126:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426316928:0@lo:8:kworker.0 00000100:00100000:3.0:1789708829.884143:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708829.884195:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426316800 00000100:00100000:3.0:1789708829.884199:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426316800 00000100:00100000:3.0:1789708829.884219:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426316928 00000100:00100000:3.0:1789708829.884221:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426316928 00000100:00100000:3.0:1789708829.884230:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708829.884234:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1876645426316800:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789708829.884256:0:15031:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:3.0:1789708829.884286:0:15031:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa8f741d1c686728c 00002000:00100000:3.0:1789708829.884299:0:15031:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a13012a1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789708829.884303:0:15031:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789708829.884306:0:15031:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789708829.886748:0:15031:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789708829.886794:0:15031:0:(import.c:65:import_set_state_nolock()) ffff8a13012a3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708829.886873:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1876645426316800:12345-0@lo:8:kworker.0 Request processed in 2637us (2777us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708829.886883:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708829.886911:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789708829.886915:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1876645426316928:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789708829.886928:0:15031:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789708829.886947:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1876645426316928:12345-0@lo:8:kworker.0 Request processed in 32us (2804us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789708829.886957:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789708829.887131:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876645426317184:12345-0@lo:400:kworker.0 Request processed in 3516us (3695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708829.887138:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789708829.887153:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708829.887158:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876645426317056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708829.887182:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1876645426317056:12345-0@lo:400:kworker.0 Request processed in 26us (3690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708829.887186:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789708829.889833:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a13082bd880 x1876645426316800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789708849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708829.889847:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789708829.889857:0:3285:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789708829.889866:0:3285:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789708829.889872:0:3285:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789708829.889875:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a1423226800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789708829.889904:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789708829.889911:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426316800:0@lo:8:kworker.0 00000100:00080000:2.0:1789708829.889944:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a1410605000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789708829.889950:0:3285:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789708829.889953:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426316928:0@lo:8:kworker.0 00000004:00080000:3.0:1789708829.890348:0:14366:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789708829.890637:0:14367:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1789708829.890697:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14367:1876645426317440:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789708829.890779:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708829.890808:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1306c82c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708829.890823:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789708829.890833:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426317312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708829.890859:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708829.890895:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426317312 00000100:00100000:1.0:1789708829.890901:0:15033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426317312 00000100:00100000:1.0:1789708829.890952:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789708829.890961:0:15033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1876645426317312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789708829.890994:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708829.891035:0:15033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1876645426317312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708829.891042:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789708829.891079:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426317440 00000100:00100000:1.0:1789708829.891083:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426317440 00000100:00100000:1.0:1789708829.891107:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708829.891113:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14367:x1876645426317440:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789708829.893495:0:15029:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789708829.893512:0:15029:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789708829.893517:0:15029:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00080000:2.0:1789708829.893771:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789708829.894871:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a143f4e4000 x1876645426317312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708829.894900:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426317312:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1789708829.898183:0:14366:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395695529371ns, next at 0ns, rc = 0 00010000:00080000:3.0:1789708829.898298:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a13082bd500 x1876645426317056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708829.898310:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1876645426317056:0@lo:400:kworker.0 00010000:00080000:3.0:1789708829.898319:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a13082bc380 x1876645426317184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708829.898325:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876645426317184:0@lo:400:kworker.0 00002000:00010000:1.0:1789708829.933610:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.933623:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009fd6608/0xa8f741d1c6867293 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.933641:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.933645:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.933696:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009fd6608/0xa8f741d1c6867293 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.933718:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009fd6608/0xa8f741d1c6867293 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.933743:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009fd6608/0xa8f741d1c6867293 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.933752:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009fd6608/0xa8f741d1c6867293 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.933774:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.933790:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.933797:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009fd6608/0xa8f741d1c6867293 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.933805:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5a00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.933809:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009fd6608/0xa8f741d1c6867293 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.933825:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009fd6608/0xa8f741d1c6867293 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.933843:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009fd6608/0xa8f741d1c6867293 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.933851:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009fd6608/0xa8f741d1c6867293 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.933869:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.933870:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.933872:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.934336:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.934342:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8e09f56/0xa8f741d1c686729a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.934351:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.934355:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.934359:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8e09f56/0xa8f741d1c686729a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.934368:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8e09f56/0xa8f741d1c686729a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.934376:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8e09f56/0xa8f741d1c686729a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.934389:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8e09f56/0xa8f741d1c686729a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.934406:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.934416:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.934421:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8e09f56/0xa8f741d1c686729a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.934429:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4a00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.934432:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8e09f56/0xa8f741d1c686729a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.934439:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8e09f56/0xa8f741d1c686729a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.934451:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8e09f56/0xa8f741d1c686729a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.934458:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8e09f56/0xa8f741d1c686729a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.934472:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.934474:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.934475:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.947095:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.947118:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c68672a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.947136:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.947140:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.947147:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c68672a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.947162:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c68672a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.947174:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c68672a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.947182:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c68672a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.947210:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708829.948393:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708829.948406:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c68672a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708829.948416:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5800 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708829.948420:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c68672a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708829.948430:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c68672a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708829.948455:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c68672a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708829.948473:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000540e5df/0xa8f741d1c68672a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708829.948516:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708829.948517:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708829.948519:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.949361:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.949371:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047b45df7/0xa8f741d1c68672a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.949385:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.949390:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.949397:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047b45df7/0xa8f741d1c68672a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.949409:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047b45df7/0xa8f741d1c68672a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.949426:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047b45df7/0xa8f741d1c68672a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.949434:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047b45df7/0xa8f741d1c68672a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.949456:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.949632:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.949639:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047b45df7/0xa8f741d1c68672a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.951601:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4c00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.951614:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047b45df7/0xa8f741d1c68672a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.951629:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047b45df7/0xa8f741d1c68672a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.951851:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047b45df7/0xa8f741d1c68672a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.951861:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047b45df7/0xa8f741d1c68672a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.955000:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.955022:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.955025:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.958901:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.958917:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f21d1e/0xa8f741d1c68672af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.958935:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.958940:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.958946:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f21d1e/0xa8f741d1c68672af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.958961:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2f21d1e/0xa8f741d1c68672af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.958972:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2f21d1e/0xa8f741d1c68672af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.958980:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2f21d1e/0xa8f741d1c68672af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.959011:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.959031:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.959038:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2f21d1e/0xa8f741d1c68672af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.959046:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5e00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.959050:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f21d1e/0xa8f741d1c68672af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.959073:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2f21d1e/0xa8f741d1c68672af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.959091:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2f21d1e/0xa8f741d1c68672af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.959098:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2f21d1e/0xa8f741d1c68672af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.959121:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.959122:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.959124:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.960336:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.960345:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68672b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.960357:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.960361:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.960367:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68672b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.960378:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68672b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.960388:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68672b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.960402:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68672b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.960422:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.960436:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.960442:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68672b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.960449:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4000 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.960453:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68672b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.960462:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68672b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.960487:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68672b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.960494:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68672b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.960510:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.960512:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.960514:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.961133:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.961146:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d2d76be/0xa8f741d1c68672bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.961155:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.961158:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.961162:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d2d76be/0xa8f741d1c68672bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.961172:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d2d76be/0xa8f741d1c68672bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.961179:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d2d76be/0xa8f741d1c68672bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.961187:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d2d76be/0xa8f741d1c68672bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.961204:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.961213:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.961217:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d2d76be/0xa8f741d1c68672bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.961223:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5400 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.961227:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d2d76be/0xa8f741d1c68672bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.961233:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d2d76be/0xa8f741d1c68672bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.961253:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d2d76be/0xa8f741d1c68672bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.961260:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d2d76be/0xa8f741d1c68672bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.961273:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.961275:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.961277:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.961982:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.961991:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c68672c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962000:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.962003:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.962008:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c68672c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962017:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c68672c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962026:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c68672c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962033:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c68672c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962061:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.962072:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.962076:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c68672c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962083:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4400 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.962086:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c68672c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962094:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c68672c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962107:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c68672c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962114:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c68672c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962128:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.962130:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.962132:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.962498:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.962504:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac995662/0xa8f741d1c68672cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962512:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.962519:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.962524:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac995662/0xa8f741d1c68672cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962532:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac995662/0xa8f741d1c68672cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962541:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac995662/0xa8f741d1c68672cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962548:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac995662/0xa8f741d1c68672cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962562:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.962570:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.962574:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac995662/0xa8f741d1c68672cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962581:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4200 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.962584:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac995662/0xa8f741d1c68672cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962592:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac995662/0xa8f741d1c68672cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962602:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac995662/0xa8f741d1c68672cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962618:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac995662/0xa8f741d1c68672cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.962631:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.962633:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.962635:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.963021:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.963027:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000851aaf10/0xa8f741d1c68672d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963035:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.963039:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.963042:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000851aaf10/0xa8f741d1c68672d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963050:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000851aaf10/0xa8f741d1c68672d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963058:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000851aaf10/0xa8f741d1c68672d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963063:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000851aaf10/0xa8f741d1c68672d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963075:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.963082:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.963091:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000851aaf10/0xa8f741d1c68672d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963097:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5600 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.963100:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000851aaf10/0xa8f741d1c68672d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963107:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000851aaf10/0xa8f741d1c68672d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963116:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000851aaf10/0xa8f741d1c68672d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963122:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000851aaf10/0xa8f741d1c68672d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963134:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.963136:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.963137:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.963510:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.963516:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c68672d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963525:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.963528:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.963549:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c68672d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963570:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c68672d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963578:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c68672d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963585:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c68672d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963598:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.963607:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.963611:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c68672d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963618:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5000 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.963620:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c68672d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963627:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c68672d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963637:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c68672d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963643:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2fc1239/0xa8f741d1c68672d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.963687:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.963689:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.963690:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.964093:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.964098:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024fdfda7/0xa8f741d1c68672e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.964106:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.964109:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.964113:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024fdfda7/0xa8f741d1c68672e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.964122:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024fdfda7/0xa8f741d1c68672e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.964130:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024fdfda7/0xa8f741d1c68672e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.964137:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024fdfda7/0xa8f741d1c68672e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.964152:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.964160:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.964163:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024fdfda7/0xa8f741d1c68672e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.964182:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4600 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.964185:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024fdfda7/0xa8f741d1c68672e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.964194:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024fdfda7/0xa8f741d1c68672e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.964204:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024fdfda7/0xa8f741d1c68672e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.964210:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024fdfda7/0xa8f741d1c68672e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.964225:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.964227:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.964229:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.964605:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.964611:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a613f9f3/0xa8f741d1c68672e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.964619:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.964622:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.964626:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a613f9f3/0xa8f741d1c68672e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.964635:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a613f9f3/0xa8f741d1c68672e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.964671:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a613f9f3/0xa8f741d1c68672e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.964678:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a613f9f3/0xa8f741d1c68672e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.964691:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.964699:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.964703:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a613f9f3/0xa8f741d1c68672e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.964709:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5c00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.964712:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a613f9f3/0xa8f741d1c68672e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.964719:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a613f9f3/0xa8f741d1c68672e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.976820:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a613f9f3/0xa8f741d1c68672e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.976840:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a613f9f3/0xa8f741d1c68672e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.976876:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.976885:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.976887:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.977901:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.977910:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e567b69/0xa8f741d1c68672ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.977924:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.977929:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.977934:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e567b69/0xa8f741d1c68672ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.977946:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e567b69/0xa8f741d1c68672ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.977956:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e567b69/0xa8f741d1c68672ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.977964:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e567b69/0xa8f741d1c68672ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.977981:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.977995:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.978000:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e567b69/0xa8f741d1c68672ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.978008:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400030200 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.978012:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e567b69/0xa8f741d1c68672ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.978032:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e567b69/0xa8f741d1c68672ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.978047:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e567b69/0xa8f741d1c68672ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.978053:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e567b69/0xa8f741d1c68672ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.978069:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.978070:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.978072:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.978495:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.978501:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de751b5a/0xa8f741d1c68672f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.978509:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.978513:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.978517:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de751b5a/0xa8f741d1c68672f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.978526:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de751b5a/0xa8f741d1c68672f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.978533:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de751b5a/0xa8f741d1c68672f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.978545:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de751b5a/0xa8f741d1c68672f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.978558:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.978567:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.978571:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de751b5a/0xa8f741d1c68672f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.978577:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400030a00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.978580:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de751b5a/0xa8f741d1c68672f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.978587:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de751b5a/0xa8f741d1c68672f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.978597:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de751b5a/0xa8f741d1c68672f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.978604:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de751b5a/0xa8f741d1c68672f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.978617:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.978619:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.978620:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.979065:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.979076:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4942b93/0xa8f741d1c68672fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979085:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.979088:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.979094:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4942b93/0xa8f741d1c68672fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979103:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4942b93/0xa8f741d1c68672fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979111:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4942b93/0xa8f741d1c68672fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979117:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4942b93/0xa8f741d1c68672fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979131:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.979139:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.979143:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4942b93/0xa8f741d1c68672fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979149:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400031200 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.979154:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4942b93/0xa8f741d1c68672fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979161:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4942b93/0xa8f741d1c68672fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979178:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4942b93/0xa8f741d1c68672fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979185:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4942b93/0xa8f741d1c68672fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979200:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.979201:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.979203:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.979580:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.979586:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068dbec3c/0xa8f741d1c6867303 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979595:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.979598:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.979602:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068dbec3c/0xa8f741d1c6867303 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979611:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068dbec3c/0xa8f741d1c6867303 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979619:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068dbec3c/0xa8f741d1c6867303 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979625:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068dbec3c/0xa8f741d1c6867303 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979671:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.979681:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.979685:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068dbec3c/0xa8f741d1c6867303 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979692:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400031c00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.979696:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068dbec3c/0xa8f741d1c6867303 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979705:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068dbec3c/0xa8f741d1c6867303 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979717:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068dbec3c/0xa8f741d1c6867303 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979724:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068dbec3c/0xa8f741d1c6867303 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.979751:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.979753:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.979755:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.980123:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.980129:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038f71220/0xa8f741d1c686730a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.980138:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.980146:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.980150:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038f71220/0xa8f741d1c686730a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.980159:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038f71220/0xa8f741d1c686730a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.980166:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038f71220/0xa8f741d1c686730a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.980172:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038f71220/0xa8f741d1c686730a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.980186:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.980194:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.980197:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038f71220/0xa8f741d1c686730a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.980203:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400031600 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.980206:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038f71220/0xa8f741d1c686730a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.980212:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038f71220/0xa8f741d1c686730a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.980221:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038f71220/0xa8f741d1c686730a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.980239:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038f71220/0xa8f741d1c686730a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.980251:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.980252:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.980254:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.980636:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.980641:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcd26845/0xa8f741d1c6867311 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.980677:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.980680:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.980684:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcd26845/0xa8f741d1c6867311 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.980693:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcd26845/0xa8f741d1c6867311 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.980701:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcd26845/0xa8f741d1c6867311 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.980707:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcd26845/0xa8f741d1c6867311 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.980721:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1789708829.990344:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1789708829.991807:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.991826:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcd26845/0xa8f741d1c6867311 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.991840:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400031400 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.991845:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcd26845/0xa8f741d1c6867311 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.991857:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcd26845/0xa8f741d1c6867311 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.991879:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcd26845/0xa8f741d1c6867311 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.991887:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcd26845/0xa8f741d1c6867311 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.991918:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.991920:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.991923:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.993121:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.993131:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3744945/0xa8f741d1c6867318 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993145:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.993149:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.993155:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3744945/0xa8f741d1c6867318 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993181:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3744945/0xa8f741d1c6867318 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993202:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3744945/0xa8f741d1c6867318 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993211:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3744945/0xa8f741d1c6867318 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993237:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789708829.993709:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.993715:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da65f42c/0xa8f741d1c686731f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993724:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.993727:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.993742:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da65f42c/0xa8f741d1c686731f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993751:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da65f42c/0xa8f741d1c686731f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993760:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da65f42c/0xa8f741d1c686731f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993777:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da65f42c/0xa8f741d1c686731f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993793:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789708829.993805:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789708829.993810:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3744945/0xa8f741d1c6867318 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993818:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400030e00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.993822:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3744945/0xa8f741d1c6867318 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993831:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3744945/0xa8f741d1c6867318 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993845:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3744945/0xa8f741d1c6867318 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993852:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3744945/0xa8f741d1c6867318 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993868:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.993871:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da65f42c/0xa8f741d1c686731f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993888:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400030800 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.993891:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da65f42c/0xa8f741d1c686731f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993899:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da65f42c/0xa8f741d1c686731f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993907:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da65f42c/0xa8f741d1c686731f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993913:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da65f42c/0xa8f741d1c686731f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.993925:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.993926:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.993928:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.994320:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.994327:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce106dc8/0xa8f741d1c6867326 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994336:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.994339:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.994343:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce106dc8/0xa8f741d1c6867326 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994353:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce106dc8/0xa8f741d1c6867326 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994367:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce106dc8/0xa8f741d1c6867326 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994375:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce106dc8/0xa8f741d1c6867326 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994390:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.994399:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.994403:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce106dc8/0xa8f741d1c6867326 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994410:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400031000 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.994413:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce106dc8/0xa8f741d1c6867326 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994422:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce106dc8/0xa8f741d1c6867326 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994433:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce106dc8/0xa8f741d1c6867326 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994440:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce106dc8/0xa8f741d1c6867326 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994454:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.994461:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.994462:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.994884:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.994890:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000514c2c79/0xa8f741d1c686732d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994898:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.994902:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.994906:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000514c2c79/0xa8f741d1c686732d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994913:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000514c2c79/0xa8f741d1c686732d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994921:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000514c2c79/0xa8f741d1c686732d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994927:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000514c2c79/0xa8f741d1c686732d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994941:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.994948:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.994951:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000514c2c79/0xa8f741d1c686732d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994957:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400030000 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.994960:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000514c2c79/0xa8f741d1c686732d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994978:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000514c2c79/0xa8f741d1c686732d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994988:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000514c2c79/0xa8f741d1c686732d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.994995:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000514c2c79/0xa8f741d1c686732d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.995009:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.995011:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.995012:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708829.995389:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708829.995394:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed7bd37c/0xa8f741d1c6867334 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.995402:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708829.995405:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708829.995409:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed7bd37c/0xa8f741d1c6867334 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.995418:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed7bd37c/0xa8f741d1c6867334 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.995426:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed7bd37c/0xa8f741d1c6867334 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.995445:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed7bd37c/0xa8f741d1c6867334 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.995459:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789708829.995467:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708829.995471:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed7bd37c/0xa8f741d1c6867334 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.995478:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400031e00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708829.995481:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed7bd37c/0xa8f741d1c6867334 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.995489:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed7bd37c/0xa8f741d1c6867334 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.995500:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed7bd37c/0xa8f741d1c6867334 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.995507:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed7bd37c/0xa8f741d1c6867334 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708829.995522:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.995524:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708829.995525:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708829.995926:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708830.002982:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708830.003005:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcca442f/0xa8f741d1c686733b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.003023:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708830.003028:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708830.003034:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcca442f/0xa8f741d1c686733b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.003048:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcca442f/0xa8f741d1c686733b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.003059:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcca442f/0xa8f741d1c686733b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.003066:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcca442f/0xa8f741d1c686733b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.003132:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789708830.003968:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708830.003976:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052a9bb2c/0xa8f741d1c6867342 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.003986:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708830.003990:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708830.003994:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052a9bb2c/0xa8f741d1c6867342 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.004003:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052a9bb2c/0xa8f741d1c6867342 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.004018:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052a9bb2c/0xa8f741d1c6867342 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.004026:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052a9bb2c/0xa8f741d1c6867342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.004803:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789708830.004814:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcca442f/0xa8f741d1c686733b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.004825:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400030c00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:2.0:1789708830.004829:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcca442f/0xa8f741d1c686733b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.004840:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcca442f/0xa8f741d1c686733b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.004877:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcca442f/0xa8f741d1c686733b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.004885:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcca442f/0xa8f741d1c686733b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.004911:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708830.004914:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052a9bb2c/0xa8f741d1c6867342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.004921:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed9c00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:2.0:1789708830.004925:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052a9bb2c/0xa8f741d1c6867342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.004933:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052a9bb2c/0xa8f741d1c6867342 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.004942:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052a9bb2c/0xa8f741d1c6867342 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.004948:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708830.004950:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708830.004952:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708830.005069:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708830.005094:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789708830.005101:0:15029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052a9bb2c/0xa8f741d1c6867342 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789708830.005924:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708830.005932:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc273d7e/0xa8f741d1c6867349 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.005945:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708830.005950:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708830.005956:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc273d7e/0xa8f741d1c6867349 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.005967:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc273d7e/0xa8f741d1c6867349 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.005978:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc273d7e/0xa8f741d1c6867349 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.006001:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc273d7e/0xa8f741d1c6867349 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.007964:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789708830.008588:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708830.008753:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a29dcb53/0xa8f741d1c6867350 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.008770:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1789708830.008774:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708830.008780:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a29dcb53/0xa8f741d1c6867350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.008794:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a29dcb53/0xa8f741d1c6867350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.008804:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a29dcb53/0xa8f741d1c6867350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.008812:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a29dcb53/0xa8f741d1c6867350 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.011073:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789708830.011087:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc273d7e/0xa8f741d1c6867349 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.011108:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed8000 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:2.0:1789708830.011113:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc273d7e/0xa8f741d1c6867349 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.011125:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc273d7e/0xa8f741d1c6867349 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.011144:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc273d7e/0xa8f741d1c6867349 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.011151:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc273d7e/0xa8f741d1c6867349 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.011178:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708830.011181:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a29dcb53/0xa8f741d1c6867350 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.011187:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed8e00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:2.0:1789708830.011189:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a29dcb53/0xa8f741d1c6867350 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708830.011447:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00080000:1.0:1789708830.011945:0:15029:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1789708830.012051:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14367:x1876645426317440:12345-0@lo:5:osp-pre-0-0.0 Request processed in 120933us (121267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708830.012069:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789708830.012129:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14367:1876645426317440:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789708830.012143:0:14367:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1789708830.012187:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14367:1876645426317568:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1789708830.012305:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708830.013906:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a29dcb53/0xa8f741d1c6867350 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.013930:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a29dcb53/0xa8f741d1c6867350 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.013951:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a29dcb53/0xa8f741d1c6867350 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708830.013979:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708830.013982:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708830.013984:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708830.014250:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708830.014309:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1306c82c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789708830.014331:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426317568 00000100:00100000:1.0:1789708830.014338:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426317568 00000100:00100000:1.0:1789708830.014390:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789708830.014402:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14367:x1876645426317568:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789708830.014456:0:15031:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1789708830.038427:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14367:x1876645426317568:12345-0@lo:5:osp-pre-0-0.0 Request processed in 24017us (24169us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789708830.038442:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789708830.048663:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14367:1876645426317568:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789708830.048685:0:14367:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1789708830.597685:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708831.617402:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789708832.018041:0:15747:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789708832.018045:0:15747:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789708832.018149:0:15747:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a1404166000 00000020:01000004:2.0:1789708832.018166:0:15747:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789708832.018249:0:15747:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789708832.018279:0:15747:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a130930b380) 00000020:00000080:2.0:1789708832.018301:0:15747:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789708832.039304:0:15747:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789708832.039596:0:15747:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789708832.040557:0:15747:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789708832.041398:0:15747:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789708832.041744:0:15747:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789708832.042162:0:15747:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 403: rc = 0 00100000:10000000:2.0:1789708832.042343:0:15747:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 403: rc = 0 00100000:10000000:2.0:1789708832.042478:0:15747:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:2.0:1789708832.043093:0:15747:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 546: rc = 0 00100000:10000000:2.0:1789708832.043536:0:15747:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 546: rc = 0 00100000:10000000:2.0:1789708832.043928:0:15747:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 546: rc = 0 00100000:10000000:2.0:1789708832.044261:0:15747:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 546: rc = 0 00100000:10000000:2.0:1789708832.044504:0:15747:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 546: rc = 0 00100000:10000000:2.0:1789708832.044961:0:15747:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 546: rc = 0 00000020:00000080:2.0:1789708832.045892:0:15747:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789708832.045905:0:15747:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789708832.045915:0:15747:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa8f741d1c686735e 00000020:01000004:2.0:1789708832.045922:0:15747:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789708832.045944:0:15747:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.153@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789708832.045948:0:15747:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789708832.045953:0:15747:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789708832.045976:0:15747:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789708832.045981:0:15747:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789708832.057905:0:15747:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789708832.057956:0:15747:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.153@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789708832.057960:0:15747:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789708832.057962:0:15747:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789708832.057963:0:15747:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708832.057965:0:15747:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708832.057966:0:15747:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708832.057967:0:15747:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708832.057969:0:15747:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789708832.057970:0:15747:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708832.057971:0:15747:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789708832.057975:0:15747:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789708832.057977:0:15747:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789708832.057978:0:15747:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789708832.057979:0:15747:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789708832.057980:0:15747:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789708832.057981:0:15747:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789708832.057983:0:15747:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789708832.057984:0:15747:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789708832.057985:0:15747:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789708832.057986:0:15747:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789708832.058023:0:15747:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789708832.058049:0:15747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426317696:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789708832.058132:0:15747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708832.058399:0:15747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1401370000 going to sleep for 11 seconds 00000100:00100000:1.0:1789708832.058474:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426317696 00000100:00100000:1.0:1789708832.058483:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426317696 00000100:00100000:1.0:1789708832.058568:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789708832.058578:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:15747:x1876645426317696:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789708832.058606:0:14339:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789708832.058610:0:14339:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789708832.058614:0:14339:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789708832.066129:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:15747:x1876645426317696:12345-0@lo:253:mount.lustre.0 Request processed in 7543us (7987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708832.066146:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789708832.066314:0:15747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426317696:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789708832.066331:0:15747:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789708832.066334:0:15747:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789708832.066336:0:15747:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789708832.066337:0:15747:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789708832.066339:0:15747:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789708832.066340:0:15747:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789708832.066342:0:15747:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789708832.066343:0:15747:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789708832.066345:0:15747:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789708832.066346:0:15747:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789708832.066384:0:15747:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a1404166000 from lustre-OST0001 10000000:01000000:3.0:1789708832.066414:0:15747:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789708832.066417:0:15747:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789708832.066425:0:15747:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a14077019c0 local copy 00010000:00010000:3.0:1789708832.066435:0:15747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c6867104 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686710b expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708832.066780:0:15747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426317824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708832.066821:0:15747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708832.066858:0:15747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405815b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708832.066927:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426317824 00000100:00100000:1.0:1789708832.066935:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426317824 00000100:00100000:1.0:1789708832.066980:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789708832.067000:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:15747:x1876645426317824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708832.067202:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:15747:x1876645426317824:12345-0@lo:501:mount.lustre.0 Request processed in 213us (379us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789708832.067209:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789708832.067596:0:15747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426317824:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789708832.067613:0:15747:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789708832.067819:0:15747:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789708832.067832:0:15747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c6867104 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686710b expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.067843:0:15747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa38800/0xa8f741d1c6867104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686710b expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708832.067871:0:15747:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a1404166000 10000000:01000000:3.0:1789708832.067877:0:15747:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789708832.067882:0:15747:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789708832.067885:0:15747:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789708832.067890:0:15747:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789708832.067894:0:15747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789708832.067917:0:15747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa39000/0xa8f741d1c6867365 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.067925:0:15747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143fa39000/0xa8f741d1c6867365 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.067934:0:15747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143fa39000/0xa8f741d1c6867365 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708832.067948:0:15747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426317952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708832.067980:0:15747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708832.068012:0:15747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405815b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789708832.068143:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426317952 00000100:00100000:2.0:1789708832.068149:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426317952 00000100:00100000:2.0:1789708832.068199:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789708832.068207:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:15747:x1876645426317952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708832.068219:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708832.068232:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1403b6a200/0xa8f741d1c686736c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6867365 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708832.068255:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1403b6a200/0xa8f741d1c686736c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6867365 expref: 17 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708832.068266:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1403b6a200/0xa8f741d1c686736c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6867365 expref: 17 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708832.068275:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6a200, rc 0) 00000100:00100000:2.0:1789708832.068317:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+17:15747:x1876645426317952:12345-0@lo:101:mount.lustre.0 Request processed in 110us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708832.068323:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789708832.068455:0:15747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426317952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708832.068467:0:15747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143fa39000/0xa8f741d1c6867365 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686736c expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.068476:0:15747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143fa39000/0xa8f741d1c6867365 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c686736c expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708832.069360:0:15747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789708832.070549:0:15747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708832.070959:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789708832.071010:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789708832.071047:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789708832.071100:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789708832.071138:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789708832.071167:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789708832.071372:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789708832.071381:0:15747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789708832.071492:0:15747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426318080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708832.071559:0:15747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708832.071911:0:15747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405815cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708832.072337:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426318080 00000100:00100000:2.0:1789708832.072345:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426318080 00000100:00100000:2.0:1789708832.072406:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789708832.072415:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+17:15747:x1876645426318080:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708832.074117:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+17:15747:x1876645426318080:12345-0@lo:501:mount.lustre.0 Request processed in 1698us (2553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708832.074130:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789708832.074279:0:15747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426318080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708832.074342:0:15747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426318208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789708832.074391:0:15747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708832.074485:0:15747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1403666540 going to sleep for 11 seconds 00000100:00100000:1.0:1789708832.074524:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426318208 00000100:00100000:1.0:1789708832.074531:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426318208 00000100:00100000:1.0:1789708832.074609:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789708832.074618:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+17:15747:x1876645426318208:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708832.075282:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+17:15747:x1876645426318208:12345-0@lo:503:mount.lustre.0 Request processed in 663us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708832.075293:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789708832.075370:0:15747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426318208:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789708832.076440:0:15747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789708832.076534:0:15747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426318336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708832.076595:0:15747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708832.081866:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426318336 00000100:00100000:2.0:1789708832.081882:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426318336 00000100:00100000:3.0:1789708832.082296:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789708832.082309:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+17:15747:x1876645426318336:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708832.082872:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+17:15747:x1876645426318336:12345-0@lo:502:mount.lustre.0 Request processed in 563us (6274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708832.082882:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789708832.083062:0:15747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1401370000 going to sleep for 11 seconds 00000100:00100000:3.0:1789708832.083088:0:15747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426318336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789708832.083411:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789708832.083460:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789708832.083486:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789708832.083528:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789708832.083562:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789708832.083595:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789708832.083844:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789708832.083888:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789708832.083940:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789708832.083984:0:15747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426318464:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708832.084047:0:15747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708832.084129:0:15747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14050739c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708832.084168:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426318464 00000100:00100000:2.0:1789708832.084240:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426318464 00000100:00100000:2.0:1789708832.084336:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789708832.084345:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+17:15747:x1876645426318464:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708832.084578:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+17:15747:x1876645426318464:12345-0@lo:502:mount.lustre.0 Request processed in 234us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708832.084586:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789708832.084884:0:15747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426318464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789708832.084964:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789708832.084974:0:15747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1789708832.086159:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789708832.086168:0:15749:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789708832.086248:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789708832.086250:0:15749:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789708832.086257:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789708832.086271:0:15749:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a143d3219c0) 00000020:00000080:1.0:1789708832.086303:0:15749:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789708832.086310:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789708832.086375:0:15749:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1404166000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789708832.086384:0:15749:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789708832.086390:0:15749:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa8f741d1c686737a 00010000:00010000:0.0:1789708832.090984:0:15749:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1789708832.093123:0:15749:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1789708832.096107:0:15749:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789708832.098397:0:15749:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789708832.098417:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708832.098424:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708832.098427:0:15749:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789708832.098430:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708832.098434:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708832.098435:0:15749:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789708832.098438:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789708832.098440:0:15749:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789708832.098442:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708832.098444:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708832.098445:0:15749:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789708832.098447:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708832.098450:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708832.098452:0:15749:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789708832.099532:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789708832.099609:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708832.099614:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708832.099616:0:15749:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789708832.099619:0:15749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789708832.100100:0:15747:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789708832.100138:0:15747:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789708832.100162:0:15747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa39000/0xa8f741d1c6867365 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686736c expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.100183:0:15747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa39000/0xa8f741d1c6867365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c686736c expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708832.100193:0:15747:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1404166000 from 1 10000000:01000000:3.0:1789708832.100196:0:15747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708832.100233:0:15747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c6867381 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.100253:0:15747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c6867381 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.100265:0:15747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c6867381 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708832.100289:0:15747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426318592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708832.100355:0:15747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708832.100396:0:15747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14050739c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708832.100518:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426318592 00000100:00100000:2.0:1789708832.100529:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426318592 00000100:00100000:2.0:1789708832.100575:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789708832.100583:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140e318c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+17:15747:x1876645426318592:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789708832.100596:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708832.100607:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1403b6a600/0xa8f741d1c6867388 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c6867381 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708832.100629:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1403b6a600/0xa8f741d1c6867388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c6867381 expref: 18 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708832.100673:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1403b6a600/0xa8f741d1c6867388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6867381 expref: 18 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708832.100695:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6a600, rc 0) 00000100:00100000:2.0:1789708832.100744:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140e318c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+18:15747:x1876645426318592:12345-0@lo:101:mount.lustre.0 Request processed in 161us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708832.100750:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789708832.100971:0:15747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426318592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708832.100985:0:15747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c6867381 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867388 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.101006:0:15747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c6867381 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6867388 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708832.101601:0:15747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789708832.103910:0:15747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708832.104206:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789708832.104251:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789708832.104310:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789708832.104318:0:15747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789708832.104414:0:15747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426318720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708832.104478:0:15747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708832.104827:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426318720 00000100:00100000:2.0:1789708832.104835:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426318720 00000100:00100000:3.0:1789708832.107831:0:15747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14050739c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708832.108044:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789708832.108062:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140e319450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+18:15747:x1876645426318720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789708832.108474:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140e319450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+18:15747:x1876645426318720:12345-0@lo:501:mount.lustre.0 Request processed in 420us (3995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708832.108482:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789708832.108598:0:15747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426318720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789708832.108690:0:15747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426318848:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789708832.108750:0:15747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708832.108779:0:15747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1306c82480 going to sleep for 11 seconds 00000100:00100000:2.0:1789708832.108904:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426318848 00000100:00100000:2.0:1789708832.108911:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426318848 00000100:00100000:2.0:1789708832.108944:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789708832.108951:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140e319850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+18:15747:x1876645426318848:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789708832.109167:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140e319850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+18:15747:x1876645426318848:12345-0@lo:503:mount.lustre.0 Request processed in 215us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708832.109293:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789708832.109375:0:15747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426318848:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789708832.110397:0:15747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789708832.110491:0:15747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426318976:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708832.110548:0:15747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708832.110682:0:15747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1306c82480 going to sleep for 11 seconds 00000100:00100000:3.0:1789708832.113319:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426318976 00000100:00100000:3.0:1789708832.113335:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426318976 00000100:00100000:3.0:1789708832.113404:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789708832.113414:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140e31bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+18:15747:x1876645426318976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708832.113795:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140e31bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+18:15747:x1876645426318976:12345-0@lo:502:mount.lustre.0 Request processed in 382us (3245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708832.113805:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789708832.114469:0:15747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426318976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789708832.114861:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789708832.114922:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789708832.114987:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789708832.115027:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789708832.115062:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789708832.115113:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789708832.115151:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789708832.115274:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789708832.115315:0:15747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426319104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789708832.115379:0:15747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708832.115480:0:15747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1306c82480 going to sleep for 11 seconds 00000100:00100000:2.0:1789708832.116862:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426319104 00000100:00100000:2.0:1789708832.116875:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426319104 00000100:00100000:2.0:1789708832.117967:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789708832.117983:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140509f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+18:15747:x1876645426319104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789708832.118280:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140509f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+18:15747:x1876645426319104:12345-0@lo:502:mount.lustre.0 Request processed in 303us (2900us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708832.118289:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789708832.118485:0:15747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426319104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789708832.118672:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789708832.118690:0:15747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789708832.120268:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708832.120280:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708832.120283:0:15753:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789708832.120290:0:15753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1404166000 00000020:00000080:0.0:1789708832.120292:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789708832.120301:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708832.120303:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708832.120304:0:15753:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789708832.120307:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708832.120309:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708832.120310:0:15753:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789708832.120458:0:15753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1404166000 00000020:00000080:0.0:1789708832.120461:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789708832.120522:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708832.120525:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708832.120526:0:15753:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789708832.120529:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789708832.120532:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708832.120533:0:15753:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789708832.120537:0:15753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1404166000 00000020:00000080:0.0:1789708832.120539:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789708832.120578:0:15753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789708832.120581:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789708832.120583:0:15753:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789708832.120586:0:15753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789708832.121275:0:15747:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789708832.121312:0:15747:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708832.121336:0:15747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c6867381 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867388 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.121348:0:15747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c6867381 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867388 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708832.121398:0:15747:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789708832.121401:0:15747:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a1404166000 10000000:01000000:3.0:1789708832.121403:0:15747:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a1404166000 10000000:01000000:3.0:1789708832.121408:0:15747:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789708832.121413:0:15747:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1404166000 from 1 10000000:01000000:3.0:1789708832.121415:0:15747:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789708832.121450:0:15747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa39c00/0xa8f741d1c686738f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.121458:0:15747:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143fa39c00/0xa8f741d1c686738f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.121468:0:15747:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143fa39c00/0xa8f741d1c686738f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708832.121490:0:15747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426319232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789708832.121565:0:15747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708832.121608:0:15747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14050739c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708832.122778:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426319232 00000100:00100000:3.0:1789708832.122789:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426319232 00000100:00100000:3.0:1789708832.122837:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789708832.122845:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140509c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+18:15747:x1876645426319232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708832.122861:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708832.122877:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6867396 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c686738f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.122901:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6867396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c686738f expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.122911:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa39200/0xa8f741d1c6867396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686738f expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.122919:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39200, rc 0) 00000100:00100000:3.0:1789708832.122969:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140509c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:15747:x1876645426319232:12345-0@lo:101:mount.lustre.0 Request processed in 125us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708832.122976:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789708832.123028:0:15747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426319232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789708832.123043:0:15747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143fa39c00/0xa8f741d1c686738f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867396 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.123051:0:15747:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143fa39c00/0xa8f741d1c686738f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6867396 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789708832.127470:0:15747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789708832.127954:0:15747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789708832.130392:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789708832.130488:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789708832.130524:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789708832.130575:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789708832.130613:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789708832.132775:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789708832.132853:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789708832.132887:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789708832.132938:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789708832.133238:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789708832.133280:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789708832.133333:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789708832.133385:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789708832.133419:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789708832.133471:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789708832.133507:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789708832.138412:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789708832.138552:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789708832.138593:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789708832.138627:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789708832.138778:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789708832.138810:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789708832.138840:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789708832.138886:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789708832.138922:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789708832.139247:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789708832.139309:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789708832.139348:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789708832.139412:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789708832.139459:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1789708832.139494:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1789708832.139545:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1789708832.139593:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1789708832.141089:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1789708832.143818:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1789708832.143985:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1789708832.144021:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1789708832.144122:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1789708832.144130:0:15747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789708832.148009:0:15747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426319360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708832.148084:0:15747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708832.148130:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426319360 00000100:00100000:3.0:1789708832.148137:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426319360 00000100:00100000:1.0:1789708832.163540:0:15747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14050739c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708832.172370:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789708832.172393:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a140509d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:15747:x1876645426319360:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789708832.172753:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a140509d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:15747:x1876645426319360:12345-0@lo:501:mount.lustre.0 Request processed in 368us (24667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708832.172761:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789708832.173053:0:15747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426319360:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789708832.173117:0:15747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426319488:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789708832.173168:0:15747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708832.173214:0:15747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14050739c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708832.175045:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426319488 00000100:00100000:2.0:1789708832.175059:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426319488 00000100:00100000:2.0:1789708832.175121:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789708832.175132:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:15747:x1876645426319488:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789708832.175393:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:15747:x1876645426319488:12345-0@lo:503:mount.lustre.0 Request processed in 263us (2225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708832.175400:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789708832.177978:0:15747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426319488:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789708832.179849:0:15747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789708832.179962:0:15747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426319616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708832.180046:0:15747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708832.180091:0:15747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1410bda000 going to sleep for 11 seconds 00000100:00100000:3.0:1789708832.183316:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426319616 00000100:00100000:3.0:1789708832.183333:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426319616 00000100:00100000:3.0:1789708832.183405:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789708832.183416:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:15747:x1876645426319616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708832.183758:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:15747:x1876645426319616:12345-0@lo:502:mount.lustre.0 Request processed in 343us (3710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708832.183767:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789708832.187462:0:15747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426319616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789708832.187814:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789708832.187879:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789708832.187916:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789708832.187967:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789708832.188016:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789708832.188092:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789708832.188147:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789708832.188322:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789708832.188371:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789708832.188401:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789708832.188430:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789708832.188473:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789708832.188921:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789708832.188961:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789708832.189011:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789708832.189048:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789708832.189080:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789708832.189127:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789708832.189163:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789708832.190101:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789708832.190163:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789708832.190215:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789708832.190271:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789708832.190320:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789708832.190375:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789708832.190416:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789708832.191103:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789708832.191157:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789708832.192556:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789708832.192636:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789708832.193047:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789708832.193087:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789708832.193122:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789708832.193168:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789708832.193287:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789708832.193332:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789708832.193372:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789708832.193422:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789708832.193513:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789708832.193554:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789708832.193601:0:15747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426319744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789708832.194800:0:15747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708832.194865:0:15747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1410bda000 going to sleep for 11 seconds 00000100:00100000:3.0:1789708832.194967:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426319744 00000100:00100000:3.0:1789708832.194976:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426319744 00000100:00100000:3.0:1789708832.195041:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789708832.195054:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:15747:x1876645426319744:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789708832.195359:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:15747:x1876645426319744:12345-0@lo:502:mount.lustre.0 Request processed in 308us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708832.195374:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789708832.195528:0:15747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426319744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789708832.195716:0:15747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789708832.195732:0:15747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789708832.202122:0:15758:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789708832.202138:0:15758:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a143442cd40) 00000020:00000080:3.0:1789708832.202162:0:15758:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1789708832.204392:0:15758:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1404166000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789708832.204402:0:15758:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1404166000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789708832.204405:0:15758:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1404166000 3 00010000:00080000:3.0:1789708832.204446:0:15758:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13033e4000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.153@tcp at head 00010000:00010000:3.0:1789708832.214085:0:15758:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1789708832.216917:0:15758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789708832.216974:0:15758:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789708832.216989:0:15758:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa8f741d1c68673a4 00000100:00080000:2.0:1789708832.217002:0:15758:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789708832.217016:0:15758:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13033e4000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1789708832.217059:0:15758:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a14344f3480 x1876645426319872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789708832.217088:0:15758:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789708832.217222:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789708832.217227:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789708832.217229:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a1410605000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789708832.217234:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 395 00000100:00080000:1.0:1789708832.217238:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789708832.217244:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a1410605000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1789708832.217256:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a143f4e7800 x1876645426320256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789708832.217296:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426320128:0@lo:400:kworker.0 00000100:00100000:1.0:1789708832.217362:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708832.217414:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789708832.217429:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426320384:0@lo:400:kworker.0 00000100:00100000:1.0:1789708832.217458:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708832.217698:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1876645426319872:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789708832.217745:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708832.217768:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426320256:0@lo:8:kworker.0 00000100:00100000:3.0:1789708832.217789:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708832.217822:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426320384 00000100:00100000:3.0:1789708832.217829:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426320384 00000100:00100000:3.0:1789708832.217866:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426319872 00000100:00100000:3.0:1789708832.217869:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426319872 00000100:00100000:3.0:1789708832.217886:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789708832.217894:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426320384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708832.217945:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426320384:12345-0@lo:400:kworker.0 Request processed in 52us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708832.217953:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789708832.217968:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789708832.217971:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3285:x1876645426319872:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789708832.217990:0:14345:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:3.0:1789708832.218022:0:14345:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa8f741d1c68673ab 00000004:00100000:3.0:1789708832.218044:0:14345:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789708832.218075:0:14345:0:(import.c:65:import_set_state_nolock()) ffff8a1306e39800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708832.218126:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876645426319872:12345-0@lo:38:llog_process_th.0 Request processed in 152us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708832.218132:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789708832.218156:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426320128 00000100:00100000:3.0:1789708832.218160:0:15032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426320128 00000100:00100000:2.0:1789708832.218276:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdca603d-b230-4a0c-9898-90b77d1d9d18:3287:1876645426320000:0@lo:400:kworker.0 00000100:00100000:2.0:1789708832.218311:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708832.218334:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789708832.218342:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426320512:0@lo:400:kworker.0 00000100:00100000:2.0:1789708832.218366:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708832.220051:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426320256 00000100:00100000:3.0:1789708832.220064:0:15032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426320256 00000100:00100000:3.0:1789708832.220083:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708832.220096:0:15032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3288:x1876645426320128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708832.220192:0:15032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3288:x1876645426320128:12345-0@lo:400:kworker.0 Request processed in 101us (2829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708832.220199:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708832.220217:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789708832.220221:0:15032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3285:x1876645426320256:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789708832.220262:0:15032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3285:x1876645426320256:12345-0@lo:8:kworker.0 Request processed in 40us (2472us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789708832.220268:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789708832.220294:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426320512 00000100:00100000:3.0:1789708832.220298:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426320512 00000100:00100000:3.0:1789708832.220323:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789708832.220330:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426320512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708832.220367:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426320512:12345-0@lo:400:kworker.0 Request processed in 38us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708832.220374:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789708832.220416:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a143f4e4a80 x1876645426320384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708832.220445:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426320384:0@lo:400:kworker.0 00000100:00100000:3.0:1789708832.220458:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426320128:0@lo:400:kworker.0 00010000:00080000:3.0:1789708832.220490:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a14344f3480 x1876645426319872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789708842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708832.220499:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789708832.220506:0:3285:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789708832.220513:0:3285:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789708832.220517:0:3285:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789708832.220520:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a13033e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789708832.220526:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1876645426319872:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789708832.220534:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789708832.220537:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a1410605000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789708832.220540:0:3285:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789708832.220543:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426320256:0@lo:8:kworker.0 00010000:00080000:3.0:1789708832.220581:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a143f4e6a00 x1876645426320512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789708832.220589:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426320512:0@lo:400:kworker.0 00000100:00100000:0.0:1789708832.221029:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426320000 00000100:00100000:0.0:1789708832.221034:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426320000 00000100:00100000:0.0:1789708832.221062:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789708832.221068:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:3287:x1876645426320000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708832.221112:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:3287:x1876645426320000:12345-0@lo:400:kworker.0 Request processed in 44us (2800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708832.221118:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789708832.221152:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdca603d-b230-4a0c-9898-90b77d1d9d18:3287:1876645426320000:0@lo:400:kworker.0 00000100:00080000:1.0:1789708832.223720:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789708832.223730:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1789708832.229195:0:15758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1789708832.229374:0:15747:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789708832.229422:0:15747:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789708832.229449:0:15747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa39c00/0xa8f741d1c686738f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867396 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.229466:0:15747:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa39c00/0xa8f741d1c686738f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867396 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789708832.229525:0:15747:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789708832.229528:0:15747:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789708832.229529:0:15747:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708832.229530:0:15747:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708832.229532:0:15747:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708832.229533:0:15747:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708832.229535:0:15747:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789708832.229536:0:15747:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708832.229538:0:15747:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789708832.229542:0:15747:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789708832.229545:0:15747:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789708832.229546:0:15747:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789708832.229547:0:15747:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708832.229548:0:15747:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708832.229549:0:15747:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708832.229550:0:15747:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708832.229551:0:15747:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789708832.229552:0:15747:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708832.229553:0:15747:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789708832.229592:0:15747:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789708832.229613:0:15747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426320640:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789708832.229737:0:15747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708832.229773:0:15747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1306c823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708832.230543:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426320640 00000100:00100000:0.0:1789708832.230555:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426320640 00000100:00100000:0.0:1789708832.230605:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789708832.230615:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:15747:x1876645426320640:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789708832.230681:0:14337:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789708832.230696:0:14337:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789708832.356464:0:14337:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789708832.356481:0:14337:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789708832.356583:0:14360:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789708832.356588:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789708832.356610:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1414ed8c00/0xa8f741d1c68673b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.356631:0:14360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1426d23e00/0xa8f741d1c6867285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686727e expref: 19 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.356641:0:14360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1414ed8c00/0xa8f741d1c68673b2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.356725:0:14360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1426d23e00/0xa8f741d1c6867285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c686727e expref: 19 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.356739:0:14360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1426d23e00/0xa8f741d1c6867285 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c686727e expref: 19 pid: 14339 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708832.356753:0:14360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14360:1876645426320768:0@lo:104: 00000100:00100000:1.0:1789708832.356816:0:14360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708832.356870:0:14360:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405008d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789708832.357052:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426320768 00000100:00100000:3.0:1789708832.357061:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426320768 00000100:00100000:3.0:1789708832.357108:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789708832.357133:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdca603d-b230-4a0c-9898-90b77d1d9d18+3:14360:x1876645426320768:12345-0@lo:104: 00010000:00010000:3.0:1789708832.357146:0:14327:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c686727e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6867285 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.357217:0:14327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789708832.357223:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdca603d-b230-4a0c-9898-90b77d1d9d18+3:14360:x1876645426320768:12345-0@lo:104: Request processed in 93us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708832.357230:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789708832.357254:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708832.357260:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c686727e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6867285 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.357268:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38600 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:3.0:1789708832.357271:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c686727e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6867285 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.357280:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c686727e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6867285 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789708832.357286:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c686727e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6867285 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708832.357292:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789708832.357320:0:14332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c686727e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6867285 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.357327:0:14332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789708832.357346:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c686727e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6867285 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708832.357836:0:14360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14360:1876645426320768:0@lo:104: 00010000:00010000:0.0:1789708832.357856:0:14360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1414ed8c00/0xa8f741d1c68673b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708832.357891:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdca603d-b230-4a0c-9898-90b77d1d9d18:3287:1876645426320896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708832.357928:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708832.358027:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426320896 00000100:00100000:1.0:1789708832.358032:0:14331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426320896 00010000:00010000:1.0:1789708832.358055:0:14331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1426d23e00/0xa8f741d1c6867285 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c686727e expref: 20 pid: 14339 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708832.358091:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789708832.358098:0:14331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdca603d-b230-4a0c-9898-90b77d1d9d18+20:3287:x1876645426320896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789708832.358109:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708832.358115:0:14331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1426d23e00/0xa8f741d1c6867285 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c686727e expref: 20 pid: 14339 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.358136:0:14331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1426d23e00/0xa8f741d1c6867285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c686727e expref: 20 pid: 14339 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.358153:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1426d23e00/0xa8f741d1c6867285 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c686727e expref: 20 pid: 14339 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.360822:0:14331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1414ed8c00/0xa8f741d1c68673b2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.360842:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1414ed8c00/0xa8f741d1c68673b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789708832.360866:0:14331:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004278643s 00010000:00010000:1.0:1789708832.360873:0:14331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1414ed8c00/0xa8f741d1c68673b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.360881:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1414ed8c00/0xa8f741d1c68673b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.360888:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1414ed8c00/0xa8f741d1c68673b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.360896:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1414ed8c00/0xa8f741d1c68673b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.360903:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed8c00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708832.360907:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1414ed8c00/0xa8f741d1c68673b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.360915:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1414ed8c00/0xa8f741d1c68673b2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.360947:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1414ed8c00/0xa8f741d1c68673b2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708832.360962:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708832.361043:0:14331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:3287:x1876645426320896:12345-0@lo:103:ldlm_bl.0 Request processed in 2942us (3111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708832.361056:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789708832.361170:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a143fa38600/0xa8f741d1c686727e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6867285 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708832.361192:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708832.361194:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708832.361196:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708832.362262:0:14360:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1414ed8c00/0xa8f741d1c68673b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708832.362275:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1414ed8c00/0xa8f741d1c68673b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708832.362282:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1414ed8c00/0xa8f741d1c68673b2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708832.362334:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdca603d-b230-4a0c-9898-90b77d1d9d18:3287:1876645426320896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789708832.378805:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+18:15747:x1876645426320640:12345-0@lo:253:mount.lustre.0 Request processed in 148181us (149058us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708832.378821:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789708832.378954:0:15747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cdca603d-b230-4a0c-9898-90b77d1d9d18:15747:1876645426320640:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789708832.378970:0:15747:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789708832.378974:0:15747:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789708832.378975:0:15747:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789708832.378977:0:15747:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789708832.378978:0:15747:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789708832.378979:0:15747:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789708832.378980:0:15747:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789708832.378982:0:15747:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789708832.378983:0:15747:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789708832.378985:0:15747:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789708832.379014:0:15747:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789708832.387791:0:15747:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789708832.387967:0:15747:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789708832.388104:0:15747:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789708832.388240:0:15747:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789708832.388373:0:15747:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789708832.388605:0:15747:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789708832.390527:0:15747:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789708832.499539:0:15747:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789708832.499550:0:15747:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789708832.499583:0:15747:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789708832.499642:0:15747:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789708832.499682:0:15747:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789708832.499723:0:15747:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789708832.637016:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789708833.601938:0:14341:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789708833.601946:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1306dcb000 from 8 10000000:01000000:0.0:1789708833.601951:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789708833.602007:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1426d22400/0xa8f741d1c68673b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.602020:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1426d22400/0xa8f741d1c68673b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.602045:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1426d22400/0xa8f741d1c68673b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708833.602073:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426321024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789708833.602144:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708833.602198:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a140319fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708833.605418:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426321024 00000100:00100000:3.0:1789708833.605432:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426321024 00000100:00100000:3.0:1789708833.605509:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789708833.605519:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+18:14341:x1876645426321024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708833.605537:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708833.605557:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa39600/0xa8f741d1c68673c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c68673b9 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.605584:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa39600/0xa8f741d1c68673c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c68673b9 expref: 19 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.605595:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa39600/0xa8f741d1c68673c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c68673b9 expref: 19 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.605615:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39600, rc 0) 00000100:00100000:3.0:1789708833.605823:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:14341:x1876645426321024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 305us (3677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708833.605830:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789708833.605897:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426321024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708833.605915:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1426d22400/0xa8f741d1c68673b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68673c0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708833.605925:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1426d22400/0xa8f741d1c68673b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c68673c0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708833.605994:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426321152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789708833.606320:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708833.606365:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405acb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789708833.606559:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426321152 00000100:00100000:0.0:1789708833.606572:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426321152 00000100:00100000:0.0:1789708833.606604:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789708833.606612:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:14341:x1876645426321152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789708833.606627:0:14338:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789708833.606643:0:14338:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789708833.606646:0:14338:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789708833.606768:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:14341:x1876645426321152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 157us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708833.606776:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789708833.606809:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426321152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789708833.606876:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789708833.606885:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1426d22400/0xa8f741d1c68673b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68673c0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708833.606894:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1426d22400/0xa8f741d1c68673b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c68673c0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708833.662392:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789708834.177324:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789708834.177419:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789708834.685870:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708835.067409:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426321280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708835.067491:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708835.067616:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426321280 00000100:00100000:1.0:1789708835.067626:0:15033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426321280 00000100:00100000:1.0:1789708835.067730:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708835.067740:0:15033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426321280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789708835.067776:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789708835.069276:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708835.078522:0:15033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426321280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10762us (11008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708835.078813:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789708835.079389:0:3288:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789708835.079448:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426321280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789708835.707587:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789708836.155434:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789708836.731031:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789708837.628567:0:485:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789708837.628576:0:485:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789708837.628580:0:485:0:(import.c:65:import_set_state_nolock()) ffff8a1410605000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789708837.628602:0:485:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a1410605000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1789708837.628631:0:485:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a14344f2680 x1876645426321664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789708837.628799:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426321920:0@lo:400:kworker.0 00000100:00100000:2.0:1789708837.628916:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708837.629000:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789708837.629007:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdca603d-b230-4a0c-9898-90b77d1d9d18:3288:1876645426321408:0@lo:400:kworker.0 00000100:00100000:2.0:1789708837.629040:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708837.629066:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876645426322048:0@lo:400:kworker.0 00000100:00100000:2.0:1789708837.629095:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708837.629123:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426321536:0@lo:400:kworker.0 00000100:00100000:2.0:1789708837.629324:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708837.629351:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789708837.629358:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426321792:0@lo:400:kworker.0 00000100:00100000:2.0:1789708837.629386:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708837.629415:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426321664:0@lo:8:kworker.0 00000100:00100000:2.0:1789708837.629441:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708837.629480:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426321920 00000100:00100000:2.0:1789708837.629489:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426321920 00000100:00100000:2.0:1789708837.629555:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426322048 00000100:00100000:2.0:1789708837.629559:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426322048 00000100:00100000:2.0:1789708837.629574:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426321792 00000100:00100000:2.0:1789708837.629595:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426321792 00000100:00100000:2.0:1789708837.629615:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789708837.629626:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426321920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708837.629729:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426321920:12345-0@lo:400:kworker.0 Request processed in 103us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708837.629739:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789708837.629761:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789708837.629768:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876645426322048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708837.629804:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876645426322048:12345-0@lo:400:kworker.0 Request processed in 36us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708837.629810:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789708837.629821:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789708837.629827:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426321792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708837.629862:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426321792:12345-0@lo:400:kworker.0 Request processed in 35us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708837.629869:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789708837.630523:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789708837.630543:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426321536 00000100:00100000:1.0:1789708837.630549:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426321536 00000100:00100000:1.0:1789708837.630598:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426321664 00000100:00100000:1.0:1789708837.630601:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426321664 00000100:00100000:1.0:1789708837.630615:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708837.630624:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426321536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708837.630720:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426321536:12345-0@lo:400:kworker.0 Request processed in 98us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708837.630728:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789708837.630746:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789708837.630752:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1876645426321664:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789708837.630793:0:15031:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 403 last 0 00000100:00100000:2.0:1789708837.638749:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426321408 00000100:00100000:2.0:1789708837.638771:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426321408 00000100:00100000:2.0:1789708837.638868:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789708837.638882:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:3288:x1876645426321408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708837.639026:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:3288:x1876645426321408:12345-0@lo:400:kworker.0 Request processed in 148us (9984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708837.639036:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1789708837.639129:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14344f0700 x1876645426321792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708837.639147:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426321792:0@lo:400:kworker.0 00000100:00100000:2.0:1789708837.639180:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426321536:0@lo:400:kworker.0 00000100:00100000:2.0:1789708837.639225:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdca603d-b230-4a0c-9898-90b77d1d9d18:3288:1876645426321408:0@lo:400:kworker.0 00010000:00080000:2.0:1789708837.639241:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14344f1880 x1876645426322048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708837.639251:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876645426322048:0@lo:400:kworker.0 00010000:00080000:2.0:1789708837.639266:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14344f3b80 x1876645426321920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708837.639274:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426321920:0@lo:400:kworker.0 00000100:00080000:1.0:1789708837.641173:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1789708837.641216:0:15031:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa8f741d1c68673c7 00002000:00100000:1.0:1789708837.641246:0:15031:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a130285b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789708837.641253:0:15031:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789708837.641258:0:15031:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789708837.641743:0:15031:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789708837.641792:0:15031:0:(import.c:65:import_set_state_nolock()) ffff8a130285d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789708837.641912:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1876645426321664:12345-0@lo:8:kworker.0 Request processed in 11155us (12466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708837.641924:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789708837.642702:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14344f2680 x1876645426321664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789708862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789708837.642726:0:3285:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789708837.642736:0:3285:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789708837.642743:0:3285:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789708837.642746:0:3285:0:(import.c:65:import_set_state_nolock()) ffff8a1410605000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789708837.642762:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789708837.642768:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1876645426321664:0@lo:8:kworker.0 00000004:00080000:2.0:1789708837.642850:0:14369:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789708837.642879:0:14369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14369:1876645426322304:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789708837.642933:0:14369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708837.642962:0:14369:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1402f31780 going to sleep for 11 seconds 00000004:00080000:2.0:1789708837.642984:0:14368:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789708837.643369:0:14368:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 403440717553ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789708837.643394:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789708837.643414:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426322176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708837.643450:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708837.643495:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426322176 00000100:00100000:2.0:1789708837.643503:0:15034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426322176 00000100:00100000:2.0:1789708837.643558:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789708837.643568:0:15034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1876645426322176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789708837.643606:0:15034:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789708837.644299:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708837.644423:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426322304 00000100:00100000:1.0:1789708837.644431:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426322304 00000100:00100000:1.0:1789708837.644483:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789708837.644493:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14369:x1876645426322304:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789708837.647185:0:15029:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789708837.647204:0:15029:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1789708837.647212:0:15029:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00010000:00080000:0.0:1789708837.652174:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14344f2680 x1876645426322176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789708853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789708837.652214:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426322176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708837.653318:0:15034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1876645426322176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708837.653336:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:1.0:1789708837.675987:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708837.676006:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a29dcb53/0xa8f741d1c68673ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.676030:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789708837.676035:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708837.676044:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a29dcb53/0xa8f741d1c68673ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.676068:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a29dcb53/0xa8f741d1c68673ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.676080:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a29dcb53/0xa8f741d1c68673ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.676088:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a29dcb53/0xa8f741d1c68673ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.676116:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789708837.677544:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708837.677565:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc273d7e/0xa8f741d1c68673d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.677580:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789708837.677585:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708837.677590:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc273d7e/0xa8f741d1c68673d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.677604:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc273d7e/0xa8f741d1c68673d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.677615:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc273d7e/0xa8f741d1c68673d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.677623:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc273d7e/0xa8f741d1c68673d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.677648:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789708837.687119:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708837.687138:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052a9bb2c/0xa8f741d1c68673dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.687770:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708837.687781:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a29dcb53/0xa8f741d1c68673ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.687793:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed8e00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708837.687798:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a29dcb53/0xa8f741d1c68673ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.687820:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a29dcb53/0xa8f741d1c68673ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.687848:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a29dcb53/0xa8f741d1c68673ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.687857:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a29dcb53/0xa8f741d1c68673ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.687879:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708837.687883:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc273d7e/0xa8f741d1c68673d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.687891:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed8000 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708837.687894:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc273d7e/0xa8f741d1c68673d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.687902:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc273d7e/0xa8f741d1c68673d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.687913:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc273d7e/0xa8f741d1c68673d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.687920:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc273d7e/0xa8f741d1c68673d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.687946:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.687948:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.687950:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.687966:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708837.688114:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789708837.688119:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708837.688127:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052a9bb2c/0xa8f741d1c68673dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.688142:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052a9bb2c/0xa8f741d1c68673dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.688493:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052a9bb2c/0xa8f741d1c68673dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.688501:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052a9bb2c/0xa8f741d1c68673dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.688527:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708837.690298:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708837.690313:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052a9bb2c/0xa8f741d1c68673dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.690327:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed9c00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708837.690333:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052a9bb2c/0xa8f741d1c68673dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.690344:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052a9bb2c/0xa8f741d1c68673dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.690366:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052a9bb2c/0xa8f741d1c68673dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.690374:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052a9bb2c/0xa8f741d1c68673dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.690401:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.690404:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.690406:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708837.691622:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708837.691636:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c68673e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.694843:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789708837.694857:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708837.694869:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c68673e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.694897:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c68673e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.694912:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c68673e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.694921:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c68673e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.694971:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708837.696749:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708837.696764:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c68673e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.696787:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed9200 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708837.696792:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c68673e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.696805:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c68673e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.696831:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c68673e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.696840:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c68673e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.696866:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.696868:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.696870:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708837.702527:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708837.702545:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c68673ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.702567:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789708837.702573:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708837.702580:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c68673ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.702596:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c68673ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.702607:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c68673ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.702615:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c68673ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.702637:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789708837.705702:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789708837.707043:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708837.707060:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c68673ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.707078:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed9400 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708837.707083:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c68673ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.707106:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c68673ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.707142:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c68673ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.707636:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c68673ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.707702:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708837.707704:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708837.707707:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708837.707816:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d1bcf3b/0xa8f741d1c68673f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.707832:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789708837.707847:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708837.707855:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d1bcf3b/0xa8f741d1c68673f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.707869:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d1bcf3b/0xa8f741d1c68673f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.707880:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d1bcf3b/0xa8f741d1c68673f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.707889:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d1bcf3b/0xa8f741d1c68673f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.707912:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708837.712611:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708837.712628:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d1bcf3b/0xa8f741d1c68673f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.712645:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed8400 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708837.712701:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d1bcf3b/0xa8f741d1c68673f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.712716:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d1bcf3b/0xa8f741d1c68673f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.712756:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d1bcf3b/0xa8f741d1c68673f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.712765:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d1bcf3b/0xa8f741d1c68673f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.712793:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.712795:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.712796:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708837.714530:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708837.714552:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000120f4c74/0xa8f741d1c68673f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.714571:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789708837.714576:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708837.714583:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000120f4c74/0xa8f741d1c68673f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.714597:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000120f4c74/0xa8f741d1c68673f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.714607:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000120f4c74/0xa8f741d1c68673f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.714623:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000120f4c74/0xa8f741d1c68673f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.714685:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708837.714694:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000120f4c74/0xa8f741d1c68673f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.714703:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed9a00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708837.714708:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000120f4c74/0xa8f741d1c68673f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.714728:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000120f4c74/0xa8f741d1c68673f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.714749:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000120f4c74/0xa8f741d1c68673f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.714772:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708837.714774:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708837.714776:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708837.716854:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789708837.716870:0:15029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000120f4c74/0xa8f741d1c68673f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789708837.721068:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708837.721083:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079d8d648/0xa8f741d1c68673ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.722258:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789708837.722265:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708837.722275:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079d8d648/0xa8f741d1c68673ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.722296:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079d8d648/0xa8f741d1c68673ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.722310:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079d8d648/0xa8f741d1c68673ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.722319:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079d8d648/0xa8f741d1c68673ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.722379:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708837.723215:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708837.723226:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079d8d648/0xa8f741d1c68673ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.723238:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed9800 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708837.723244:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079d8d648/0xa8f741d1c68673ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.723255:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079d8d648/0xa8f741d1c68673ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.723278:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079d8d648/0xa8f741d1c68673ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.723286:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079d8d648/0xa8f741d1c68673ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.723325:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.723328:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.723329:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708837.724482:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708837.724496:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c0b008/0xa8f741d1c6867406 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.724512:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789708837.724516:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708837.724522:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c0b008/0xa8f741d1c6867406 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.724536:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4c0b008/0xa8f741d1c6867406 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.724547:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c0b008/0xa8f741d1c6867406 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.724558:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c0b008/0xa8f741d1c6867406 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.724577:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789708837.725108:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708837.725115:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2f43761/0xa8f741d1c686740d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.725125:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789708837.725135:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708837.725140:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f43761/0xa8f741d1c686740d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.725151:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2f43761/0xa8f741d1c686740d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.725160:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2f43761/0xa8f741d1c686740d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.725168:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f43761/0xa8f741d1c686740d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.725190:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789708837.725599:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708837.725605:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffd1dac9/0xa8f741d1c6867414 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.725615:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789708837.725618:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708837.725622:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffd1dac9/0xa8f741d1c6867414 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.725630:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffd1dac9/0xa8f741d1c6867414 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.725638:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffd1dac9/0xa8f741d1c6867414 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.725728:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708837.725737:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4c0b008/0xa8f741d1c6867406 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.725745:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed8c00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708837.725750:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c0b008/0xa8f741d1c6867406 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.725760:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c0b008/0xa8f741d1c6867406 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.725780:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4c0b008/0xa8f741d1c6867406 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.725787:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4c0b008/0xa8f741d1c6867406 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.725809:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708837.725812:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2f43761/0xa8f741d1c686740d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.725819:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed9600 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708837.725828:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f43761/0xa8f741d1c686740d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.725837:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f43761/0xa8f741d1c686740d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.725848:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2f43761/0xa8f741d1c686740d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.725855:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2f43761/0xa8f741d1c686740d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.725870:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.725872:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.725874:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708837.726392:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708837.732112:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffd1dac9/0xa8f741d1c6867414 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.732153:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789708837.733333:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708837.733345:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a726c03/0xa8f741d1c686741b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.733364:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789708837.733368:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708837.733376:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a726c03/0xa8f741d1c686741b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.733392:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a726c03/0xa8f741d1c686741b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.733403:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a726c03/0xa8f741d1c686741b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.733411:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a726c03/0xa8f741d1c686741b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.733427:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789708837.734363:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708837.734374:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7125c9f/0xa8f741d1c6867422 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.734397:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789708837.734401:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708837.734407:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7125c9f/0xa8f741d1c6867422 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.734419:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7125c9f/0xa8f741d1c6867422 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.734430:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7125c9f/0xa8f741d1c6867422 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.734437:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7125c9f/0xa8f741d1c6867422 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.734448:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789708837.734741:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789708837.734752:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffd1dac9/0xa8f741d1c6867414 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.734762:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed8600 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708837.734768:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffd1dac9/0xa8f741d1c6867414 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.734778:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffd1dac9/0xa8f741d1c6867414 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.734805:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789708837.736266:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffd1dac9/0xa8f741d1c6867414 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.736283:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffd1dac9/0xa8f741d1c6867414 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.736310:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708837.736315:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7125c9f/0xa8f741d1c6867422 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.736323:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed9e00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708837.736335:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7125c9f/0xa8f741d1c6867422 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.736345:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7125c9f/0xa8f741d1c6867422 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.736361:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7125c9f/0xa8f741d1c6867422 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.736369:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7125c9f/0xa8f741d1c6867422 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.736382:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708837.736384:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708837.736386:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708837.736545:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708837.736553:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b059819/0xa8f741d1c6867429 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.736563:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789708837.736568:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708837.736575:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b059819/0xa8f741d1c6867429 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.736587:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b059819/0xa8f741d1c6867429 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.736607:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b059819/0xa8f741d1c6867429 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.736614:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b059819/0xa8f741d1c6867429 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.736636:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708837.736641:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708837.736645:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b059819/0xa8f741d1c6867429 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.736689:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed9000 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708837.736693:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b059819/0xa8f741d1c6867429 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.736702:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b059819/0xa8f741d1c6867429 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.736714:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b059819/0xa8f741d1c6867429 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.736740:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b059819/0xa8f741d1c6867429 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.736753:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708837.736755:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708837.736756:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708837.740986:0:15969:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708837.740995:0:15969:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708837.740998:0:15969:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708837.742423:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708837.742440:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b4b61c5/0xa8f741d1c6867430 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.742467:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789708837.742473:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708837.742480:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b4b61c5/0xa8f741d1c6867430 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.742496:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b4b61c5/0xa8f741d1c6867430 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.742509:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b4b61c5/0xa8f741d1c6867430 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.742518:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b4b61c5/0xa8f741d1c6867430 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.742551:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789708837.743030:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789708837.743040:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b4b61c5/0xa8f741d1c6867430 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.743049:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed8800 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708837.743054:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b4b61c5/0xa8f741d1c6867430 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.743064:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b4b61c5/0xa8f741d1c6867430 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.743086:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b4b61c5/0xa8f741d1c6867430 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.743094:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b4b61c5/0xa8f741d1c6867430 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708837.743141:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708837.743143:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789708837.743145:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.744024:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a726c03/0xa8f741d1c686741b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.744039:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed8a00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708837.744043:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a726c03/0xa8f741d1c686741b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.744053:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a726c03/0xa8f741d1c686741b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.744071:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a726c03/0xa8f741d1c686741b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.744088:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a726c03/0xa8f741d1c686741b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.744111:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.744113:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.744115:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789708837.745231:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708837.745242:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c31173bd/0xa8f741d1c6867437 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.745258:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789708837.745263:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708837.745270:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c31173bd/0xa8f741d1c6867437 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.745284:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c31173bd/0xa8f741d1c6867437 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.745294:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c31173bd/0xa8f741d1c6867437 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.745301:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c31173bd/0xa8f741d1c6867437 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.745325:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789708837.745877:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708837.745883:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c686743e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.748011:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789708837.748023:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708837.748031:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c686743e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.748051:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c686743e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.748064:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c686743e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.748073:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c686743e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.748194:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789708837.748734:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789708837.748745:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c31173bd/0xa8f741d1c6867437 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.748755:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed8200 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:2.0:1789708837.748759:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c31173bd/0xa8f741d1c6867437 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.748771:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c31173bd/0xa8f741d1c6867437 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789708837.748851:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789708837.748858:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c6867445 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.748867:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1789708837.748871:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708837.748876:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c6867445 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.749265:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c31173bd/0xa8f741d1c6867437 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.749275:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c31173bd/0xa8f741d1c6867437 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.749318:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708837.749322:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c686743e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.749330:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed9400 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:2.0:1789708837.749333:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c686743e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.749342:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c686743e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.749355:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c686743e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.749362:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a26c6a8/0xa8f741d1c686743e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.749376:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708837.749378:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708837.749380:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708837.750203:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c6867445 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.750227:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c6867445 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.750243:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c6867445 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.750267:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708837.750706:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708837.750715:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c6867445 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.750733:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed9200 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708837.750737:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c6867445 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.750746:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c6867445 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.750763:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c6867445 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.750771:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fdce325/0xa8f741d1c6867445 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.750794:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.750796:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.750798:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.752288:0:15969:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708837.752905:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789708837.752919:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4cb08b0/0xa8f741d1c686744c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.752940:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1789708837.752944:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708837.752952:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4cb08b0/0xa8f741d1c686744c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.752969:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4cb08b0/0xa8f741d1c686744c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.752981:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4cb08b0/0xa8f741d1c686744c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.752989:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4cb08b0/0xa8f741d1c686744c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.753008:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789708837.753363:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789708837.753372:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4cb08b0/0xa8f741d1c686744c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.753383:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23000 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:2.0:1789708837.753395:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4cb08b0/0xa8f741d1c686744c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.753406:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4cb08b0/0xa8f741d1c686744c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.753428:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4cb08b0/0xa8f741d1c686744c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.753435:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4cb08b0/0xa8f741d1c686744c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708837.753457:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708837.753460:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708837.753461:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708837.753494:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789708837.753501:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6867453 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.753509:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1789708837.753513:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708837.753518:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6867453 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.753538:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6867453 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.753546:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6867453 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.753555:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6867453 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.753569:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708837.753577:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708837.753580:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6867453 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.753587:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23a00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708837.753590:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6867453 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.753597:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6867453 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.753607:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6867453 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.753613:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c41cd422/0xa8f741d1c6867453 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.753632:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.753634:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.753635:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708837.754294:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789708837.754301:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007487ec6f/0xa8f741d1c686745a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.754312:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1789708837.754315:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708837.754320:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007487ec6f/0xa8f741d1c686745a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.754329:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007487ec6f/0xa8f741d1c686745a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.754338:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007487ec6f/0xa8f741d1c686745a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.754344:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007487ec6f/0xa8f741d1c686745a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.754359:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789708837.754896:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789708837.754903:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8e03bae/0xa8f741d1c6867461 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.754925:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1789708837.754929:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708837.754934:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8e03bae/0xa8f741d1c6867461 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.754943:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8e03bae/0xa8f741d1c6867461 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.756594:0:15969:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789708837.756610:0:15969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007487ec6f/0xa8f741d1c686745a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.756626:0:15969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22800 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708837.756631:0:15969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007487ec6f/0xa8f741d1c686745a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.756643:0:15969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007487ec6f/0xa8f741d1c686745a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.757176:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8e03bae/0xa8f741d1c6867461 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.757210:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8e03bae/0xa8f741d1c6867461 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.757255:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708837.757293:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708837.757299:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8e03bae/0xa8f741d1c6867461 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.757307:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23e00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708837.757310:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8e03bae/0xa8f741d1c6867461 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.757318:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8e03bae/0xa8f741d1c6867461 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.757359:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8e03bae/0xa8f741d1c6867461 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.757367:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8e03bae/0xa8f741d1c6867461 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.757396:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.757398:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.757401:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708837.757953:0:15969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007487ec6f/0xa8f741d1c686745a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.757962:0:15969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007487ec6f/0xa8f741d1c686745a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708837.758009:0:15969:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708837.758010:0:15969:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708837.758012:0:15969:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789708837.758030:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708837.763546:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789708837.763566:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6867468 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.763587:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1789708837.763592:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708837.763600:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6867468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.763619:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6867468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.763631:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6867468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.763640:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6867468 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.764201:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708837.764217:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708837.764224:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6867468 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.764233:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22e00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708837.764238:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6867468 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.764249:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6867468 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.764271:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6867468 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.764278:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000041ed0a4/0xa8f741d1c6867468 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.764302:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.764304:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.764306:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708837.767012:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789708837.767026:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c686746f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.767047:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1789708837.767059:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708837.767067:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c686746f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.767083:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c686746f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.767094:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c686746f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.767103:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c686746f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.767129:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789708837.767564:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789708837.767570:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079be7960/0xa8f741d1c6867476 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.767578:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1789708837.767581:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708837.767586:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079be7960/0xa8f741d1c6867476 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.767594:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079be7960/0xa8f741d1c6867476 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.767601:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079be7960/0xa8f741d1c6867476 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.767614:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079be7960/0xa8f741d1c6867476 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.767630:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789708837.768103:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789708837.768110:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3554ccb/0xa8f741d1c686747d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768119:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1789708837.768123:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708837.768127:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3554ccb/0xa8f741d1c686747d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768136:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3554ccb/0xa8f741d1c686747d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768145:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3554ccb/0xa8f741d1c686747d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768152:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3554ccb/0xa8f741d1c686747d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768168:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789708837.768189:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789708837.768196:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c686746f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768211:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22c00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708837.768216:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c686746f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768227:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c686746f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768251:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c686746f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768259:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003139b179/0xa8f741d1c686746f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768282:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708837.768286:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079be7960/0xa8f741d1c6867476 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768293:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d22600 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708837.768296:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079be7960/0xa8f741d1c6867476 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768304:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079be7960/0xa8f741d1c6867476 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768314:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079be7960/0xa8f741d1c6867476 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768328:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079be7960/0xa8f741d1c6867476 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768341:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708837.768344:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3554ccb/0xa8f741d1c686747d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768350:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a9400 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708837.768353:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3554ccb/0xa8f741d1c686747d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768360:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3554ccb/0xa8f741d1c686747d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768369:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3554ccb/0xa8f741d1c686747d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768377:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3554ccb/0xa8f741d1c686747d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768389:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.768391:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.768393:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789708837.768890:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789708837.768897:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd38e81d/0xa8f741d1c6867484 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768913:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1789708837.768917:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708837.768921:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd38e81d/0xa8f741d1c6867484 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768930:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd38e81d/0xa8f741d1c6867484 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768938:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd38e81d/0xa8f741d1c6867484 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768946:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd38e81d/0xa8f741d1c6867484 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768961:0:15029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708837.768970:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708837.768974:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd38e81d/0xa8f741d1c6867484 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768982:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a8200 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708837.768985:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd38e81d/0xa8f741d1c6867484 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.768993:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd38e81d/0xa8f741d1c6867484 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.769015:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd38e81d/0xa8f741d1c6867484 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.769023:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd38e81d/0xa8f741d1c6867484 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708837.769039:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.769041:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.769043:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789708837.769214:0:15029:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1789708837.769352:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14369:x1876645426322304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 124854us (126412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708837.769370:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789708837.769418:0:15969:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708837.769486:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708837.774783:0:14369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14369:1876645426322304:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789708837.775282:0:14369:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1789708837.775351:0:14369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14369:1876645426322432:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789708837.775437:0:14369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708837.775509:0:14369:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1404e83900 going to sleep for 11 seconds 00000100:00100000:0.0:1789708837.777450:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426322432 00000100:00100000:0.0:1789708837.777470:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426322432 00000100:00100000:0.0:1789708837.777551:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789708837.777567:0:15032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14369:x1876645426322432:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789708837.779904:0:15032:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:0.0:1789708837.785628:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789708837.789421:0:15032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14369:x1876645426322432:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11845us (13971us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789708837.789442:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789708837.790600:0:14369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14369:1876645426322432:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789708837.790625:0:14369:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1789708838.780811:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708839.802875:0:15969:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708840.188453:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789708840.188476:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426322560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708840.188551:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708840.188629:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426322560 00000100:00100000:3.0:1789708840.188645:0:15033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426322560 00000100:00100000:3.0:1789708840.188810:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789708840.188820:0:15033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426322560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789708840.188857:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708840.188916:0:15033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426322560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708840.188933:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789708840.188954:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708840.188985:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426322560:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1789708840.243132:0:16105:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789708840.827891:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708841.851105:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708842.689394:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708842.689768:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415851392 00000100:00100000:3.0:1789708842.689780:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415851392 00000100:00100000:3.0:1789708842.689828:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 75 00000100:00100000:3.0:1789708842.689836:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2360:x1876645415851392:12345-192.168.202.53@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789708842.689880:0:14339:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from e7744a29-3faa-4bfb-93f0-0fca1ce60cc2@192.168.202.53@tcp t0 exp 0000000000000000 cur 408 last 0 00000020:00000080:3.0:1789708842.689915:0:14339:0:(genops.c:1384:class_connect()) connect: client e7744a29-3faa-4bfb-93f0-0fca1ce60cc2, cookie 0xa8f741d1c686748b 00000100:00080000:3.0:1789708842.690065:0:14339:0:(import.c:65:import_set_state_nolock()) ffff8a14059e0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708842.690163:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+5:2360:x1876645415851392:12345-192.168.202.53@tcp:250:mount.lustre.0 Request processed in 325us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708842.690171:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 75 00000100:00100000:3.0:1789708842.710350:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708842.710452:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415851520 00000100:00100000:2.0:1789708842.710462:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415851520 00000100:00100000:2.0:1789708842.710523:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 76 00000100:00100000:2.0:1789708842.710533:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+5:13722:x1876645415851520:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789708842.710551:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708842.710569:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1403b6bc00/0xa8f741d1c6867492 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4bce expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708842.710597:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1403b6bc00/0xa8f741d1c6867492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4bce expref: 6 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708842.710639:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1403b6bc00/0xa8f741d1c6867492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4bce expref: 6 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708842.710689:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6bc00, rc 0) 00000100:00100000:2.0:1789708842.710757:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+6:13722:x1876645415851520:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 225us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708842.710764:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 76 00000100:00100000:1.0:1789708842.719169:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708842.719346:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415851648 00000100:00100000:2.0:1789708842.719358:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415851648 00000100:00100000:2.0:1789708842.719424:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 77 00000100:00100000:2.0:1789708842.719434:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+6:13722:x1876645415851648:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789708842.719778:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+6:13722:x1876645415851648:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 345us (617us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789708842.719787:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 77 00000100:00100000:1.0:1789708842.722343:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708842.722478:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415851776 00000100:00100000:3.0:1789708842.722488:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415851776 00000100:00100000:3.0:1789708842.722543:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 78 00000100:00100000:3.0:1789708842.722552:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+6:13722:x1876645415851776:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789708842.722568:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708842.722584:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa38600/0xa8f741d1c6867499 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4bd5 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708842.722621:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa38600/0xa8f741d1c6867499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4bd5 expref: 7 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708842.722633:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa38600/0xa8f741d1c6867499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4bd5 expref: 7 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708842.722642:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38600, rc 0) 00000100:00100000:3.0:1789708842.722738:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+7:13722:x1876645415851776:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 186us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708842.722746:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 78 00000100:00100000:3.0:1789708842.725553:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708842.725710:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415851904 00000100:00100000:0.0:1789708842.725719:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415851904 00000100:00100000:0.0:1789708842.725775:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 79 00000100:00100000:0.0:1789708842.725803:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+7:13722:x1876645415851904:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789708842.726129:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+8:13722:x1876645415851904:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 327us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708842.726139:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 79 00000100:00100000:1.0:1789708842.729434:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708842.729577:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415852032 00000100:00100000:2.0:1789708842.729587:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415852032 00000100:00100000:2.0:1789708842.729688:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 80 00000100:00100000:2.0:1789708842.729699:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+8:13722:x1876645415852032:12345-192.168.202.53@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789708842.730221:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+8:13722:x1876645415852032:12345-192.168.202.53@tcp:503:mount.lustre.0 Request processed in 522us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708842.730230:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 80 00000100:00100000:1.0:1789708842.742368:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708842.742729:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415852160 00000100:00100000:3.0:1789708842.742739:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415852160 00000100:00100000:3.0:1789708842.742807:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 81 00000100:00100000:3.0:1789708842.742816:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+8:13740:x1876645415852160:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789708842.743142:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+8:13740:x1876645415852160:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 326us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708842.743151:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 81 00000100:00100000:3.0:1789708842.748476:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426322944:0@lo:400:kworker.0 00000100:00100000:3.0:1789708842.748551:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708842.748615:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789708842.748621:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426323072:0@lo:400:kworker.0 00000100:00100000:3.0:1789708842.748646:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708842.748794:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426322816:0@lo:400:kworker.0 00000100:00100000:1.0:1789708842.748822:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708842.748849:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426323328:0@lo:400:kworker.0 00000100:00100000:1.0:1789708842.748874:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708842.748890:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789708842.748895:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdca603d-b230-4a0c-9898-90b77d1d9d18:3289:1876645426322688:0@lo:400:kworker.0 00000100:00100000:1.0:1789708842.748918:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708842.748936:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876645426323200:0@lo:400:kworker.0 00000100:00100000:1.0:1789708842.748954:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708842.749020:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426322944 00000100:00100000:3.0:1789708842.749028:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426322944 00000100:00100000:3.0:1789708842.749084:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426322816 00000100:00100000:3.0:1789708842.749088:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426322816 00000100:00100000:3.0:1789708842.749108:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708842.749117:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3286:x1876645426322944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708842.749175:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3286:x1876645426322944:12345-0@lo:400:kworker.0 Request processed in 58us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708842.749182:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789708842.749199:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789708842.749205:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426322816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789708842.749240:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426322816:12345-0@lo:400:kworker.0 Request processed in 35us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708842.749246:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789708842.749286:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426322816:0@lo:400:kworker.0 00000100:00100000:3.0:1789708842.749313:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426322944:0@lo:400:kworker.0 00000100:00080000:1.0:1789708842.749420:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789708842.749424:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708842.749495:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426323072 00000100:00100000:2.0:1789708842.749500:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426323072 00000100:00100000:2.0:1789708842.749538:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426323328 00000100:00100000:2.0:1789708842.749541:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426323328 00000100:00100000:2.0:1789708842.749586:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426323200 00000100:00100000:2.0:1789708842.749590:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426323200 00000100:00100000:2.0:1789708842.749604:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789708842.749622:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426323072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708842.749691:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426323072:12345-0@lo:400:kworker.0 Request processed in 70us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708842.749697:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789708842.749710:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789708842.749715:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426323328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708842.749748:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426323328:12345-0@lo:400:kworker.0 Request processed in 33us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708842.749754:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789708842.749764:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789708842.749769:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876645426323200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708842.749794:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876645426323200:12345-0@lo:400:kworker.0 Request processed in 25us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708842.749799:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789708842.749834:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14344c2300 x1876645426323072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708842.749846:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426323072:0@lo:400:kworker.0 00010000:00080000:2.0:1789708842.749871:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14344c3100 x1876645426323200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708842.749880:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876645426323200:0@lo:400:kworker.0 00010000:00080000:2.0:1789708842.749891:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a14344c3480 x1876645426323328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789708858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789708842.749911:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426323328:0@lo:400:kworker.0 00000100:00100000:2.0:1789708842.749932:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426322688 00000100:00100000:2.0:1789708842.749936:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426322688 00000100:00100000:2.0:1789708842.749962:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789708842.749968:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:3289:x1876645426322688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708842.750003:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434666850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:3289:x1876645426322688:12345-0@lo:400:kworker.0 Request processed in 35us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708842.750009:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789708842.750038:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdca603d-b230-4a0c-9898-90b77d1d9d18:3289:1876645426322688:0@lo:400:kworker.0 00000100:00080000:1.0:1789708842.750105:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708842.755589:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789708842.755646:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f4e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426323456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789708842.755751:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708842.760322:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426323456 00000100:00100000:1.0:1789708842.760349:0:15033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426323456 00000100:00100000:1.0:1789708842.760413:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789708842.760425:0:15033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1876645426323456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789708842.760469:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708842.760565:0:15033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1876645426323456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (4813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708842.760572:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789708842.768460:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f4e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426323456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789708842.768550:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708842.768579:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415852288 00000100:00100000:3.0:1789708842.768586:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415852288 00000100:00100000:3.0:1789708842.768665:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 83 00000100:00100000:3.0:1789708842.768674:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+8:13740:x1876645415852288:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789708842.768937:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434664050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+8:13740:x1876645415852288:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 263us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708842.768946:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 83 00000100:00100000:2.0:1789708842.782159:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708842.782672:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415852416 00000100:00100000:3.0:1789708842.782684:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415852416 00000100:00100000:3.0:1789708842.782737:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 84 00000100:00100000:3.0:1789708842.782747:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+8:13722:x1876645415852416:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789708842.782765:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708842.782784:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c68674a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4bff expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708842.782819:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c68674a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4bff expref: 9 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708842.782831:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa38e00/0xa8f741d1c68674a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4bff expref: 9 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708842.782841:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38e00, rc 0) 00000100:00100000:3.0:1789708842.782907:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434665c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+9:13722:x1876645415852416:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 160us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708842.782926:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 84 00000100:00100000:3.0:1789708842.786588:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708842.788533:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415852544 00000100:00100000:1.0:1789708842.788550:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415852544 00000100:00100000:1.0:1789708842.788644:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 85 00000100:00100000:1.0:1789708842.788691:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+9:13722:x1876645415852544:12345-192.168.202.53@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789708842.788723:0:14338:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789708842.788755:0:14338:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789708842.788760:0:14338:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789708842.788763:0:14338:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789708842.788765:0:14338:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789708842.796551:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+9:13722:x1876645415852544:12345-192.168.202.53@tcp:256:mount.lustre.0 Request processed in 7853us (9964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708842.796564:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 85 00000100:00100000:2.0:1789708842.804422:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708842.804533:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415852672 00000100:00100000:1.0:1789708842.804544:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415852672 00000100:00100000:1.0:1789708842.804602:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 86 00000100:00100000:1.0:1789708842.804624:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+9:13722:x1876645415852672:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789708842.804642:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708842.804685:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1414ed8200/0xa8f741d1c68674a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4c06 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708842.804716:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1414ed8200/0xa8f741d1c68674a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c06 expref: 10 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708842.804726:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1414ed8200/0xa8f741d1c68674a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c06 expref: 10 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708842.804745:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1414ed8200, rc 0) 00000100:00100000:1.0:1789708842.804806:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+10:13722:x1876645415852672:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 184us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708842.804813:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 86 00000100:00100000:3.0:1789708842.815869:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708842.815953:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415852800 00000100:00100000:2.0:1789708842.815965:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415852800 00000100:00100000:2.0:1789708842.816022:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 87 00000100:00100000:2.0:1789708842.816032:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434667850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+10:13722:x1876645415852800:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789708842.816463:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434667850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+10:13722:x1876645415852800:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 430us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708842.816472:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 87 00000100:00100000:3.0:1789708842.819993:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708842.821741:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415852928 00000100:00100000:0.0:1789708842.821757:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415852928 00000100:00100000:0.0:1789708842.821824:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 88 00000100:00100000:0.0:1789708842.821835:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434666c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+10:13722:x1876645415852928:12345-192.168.202.53@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789708842.822079:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434666c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+10:13722:x1876645415852928:12345-192.168.202.53@tcp:503:mount.lustre.0 Request processed in 237us (2088us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708842.822087:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 88 00000100:00100000:2.0:1789708842.830154:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708842.830671:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415853056 00000100:00100000:3.0:1789708842.830683:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415853056 00000100:00100000:3.0:1789708842.830742:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 89 00000100:00100000:3.0:1789708842.830753:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+10:13743:x1876645415853056:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789708842.831011:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+10:13743:x1876645415853056:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 258us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708842.831020:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 89 00000100:00100000:2.0:1789708842.839913:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708842.839945:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415853184 00000100:00100000:2.0:1789708842.839956:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415853184 00000100:00100000:2.0:1789708842.840006:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 90 00000100:00100000:2.0:1789708842.840016:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+10:13743:x1876645415853184:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789708842.840276:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+10:13743:x1876645415853184:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 260us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708842.840285:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 90 00000100:00100000:1.0:1789708842.860192:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708842.860467:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415853312 00000100:00100000:3.0:1789708842.860479:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415853312 00000100:00100000:3.0:1789708842.860531:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:3.0:1789708842.860539:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f4e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1876645415853312:12345-192.168.202.53@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789708842.860566:0:14344:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7@192.168.202.53@tcp t0 exp 0000000000000000 cur 408 last 0 00000020:00000080:3.0:1789708842.860627:0:14344:0:(genops.c:1384:class_connect()) connect: client 74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7, cookie 0xa8f741d1c68674ae 00000004:00100000:3.0:1789708842.860679:0:14344:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789708842.860686:0:14344:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1789708842.877055:0:15969:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789708842.882679:0:7627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1789708842.882742:0:7627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:2.0:1789708842.920728:0:14344:0:(import.c:65:import_set_state_nolock()) ffff8a13012a6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789708842.920813:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f4e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:2360:x1876645415853312:12345-192.168.202.53@tcp:38:mount.lustre.0 Request processed in 60271us (60629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708842.920828:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:2.0:1789708842.925592:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708842.925645:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708842.925857:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415853568 00000100:00100000:3.0:1789708842.925867:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415853568 00000100:00100000:3.0:1789708842.925962:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415853440 00000100:00100000:3.0:1789708842.925981:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415853440 00000100:00100000:3.0:1789708842.926011:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00080000:1.0:1789708842.926028:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708842.926038:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+7:13722:x1876645415853568:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789708842.926116:0:14345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789708842.926181:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:3.0:1789708842.926204:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+7:13722:x1876645415853568:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 181us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708842.926211:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:2.0:1789708842.926938:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:0:x1876645415853440:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789708842.926955:0:15054:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789708842.926999:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:0:x1876645415853440:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 808us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708842.927007:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:2.0:1789708842.928723:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708842.929737:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415853696 00000100:00100000:3.0:1789708842.929750:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415853696 00000100:00100000:3.0:1789708842.929885:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:3.0:1789708842.929898:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:13722:x1876645415853696:12345-192.168.202.53@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789708842.929998:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:13722:x1876645415853696:12345-192.168.202.53@tcp:40:mount.lustre.0 Request processed in 102us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708842.930005:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:0.0:1789708842.936860:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708842.936906:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708842.936997:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415853824 00000100:00100000:3.0:1789708842.937009:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415853824 00000100:00100000:3.0:1789708842.937714:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415853952 00000100:00100000:3.0:1789708842.937720:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415853952 00000100:00100000:3.0:1789708842.937740:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:3.0:1789708842.937748:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1876645415853824:12345-192.168.202.53@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789708842.937782:0:15031:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7@192.168.202.53@tcp t0 exp 0000000000000000 cur 408 last 0 00000020:00000080:3.0:1789708842.937815:0:15031:0:(genops.c:1384:class_connect()) connect: client 74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7, cookie 0xa8f741d1c68674b5 00002000:00100000:3.0:1789708842.937828:0:15031:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7/ffff8a1404160800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789708842.937864:0:15031:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789708842.938387:0:15031:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789708842.938443:0:15031:0:(import.c:65:import_set_state_nolock()) ffff8a1404160000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708842.938511:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:2360:x1876645415853824:12345-192.168.202.53@tcp:8:mount.lustre.0 Request processed in 762us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708842.938520:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:3.0:1789708842.938542:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:3.0:1789708842.938546:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1876645415853952:12345-192.168.202.53@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789708842.938565:0:15031:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7@192.168.202.53@tcp t0 exp 0000000000000000 cur 408 last 0 00000020:00000080:3.0:1789708842.938582:0:15031:0:(genops.c:1384:class_connect()) connect: client 74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7, cookie 0xa8f741d1c68674bc 00002000:00100000:3.0:1789708842.938588:0:15031:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7/ffff8a1404167000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789708842.938595:0:15031:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789708842.940482:0:15031:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789708842.940528:0:15031:0:(import.c:65:import_set_state_nolock()) ffff8a13033e6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708842.940590:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:2360:x1876645415853952:12345-192.168.202.53@tcp:8:mount.lustre.0 Request processed in 2040us (3682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708842.940601:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:3.0:1789708842.944622:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708842.944746:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415854080 00000100:00100000:1.0:1789708842.944757:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415854080 00000100:00100000:1.0:1789708842.944821:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:1.0:1789708842.944833:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:13722:x1876645415854080:12345-192.168.202.53@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789708842.958738:0:14347:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 13832us 00000004:00200000:1.0:1789708842.976472:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789708842.976629:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:13722:x1876645415854080:12345-192.168.202.53@tcp:33:mount.lustre.0 Request processed in 31793us (32020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708842.976642:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:3.0:1789708843.252694:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708843.252886:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415854208 00000100:00100000:2.0:1789708843.252899:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415854208 00000100:00100000:2.0:1789708843.252980:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:2.0:1789708843.252991:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:13764:x1876645415854208:12345-192.168.202.53@tcp:101:mkdir.0 00010000:00010000:2.0:1789708843.253016:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708843.253046:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b400/0xa8f741d1c68674c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4c30 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708843.253133:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68674ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708843.253148:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68674ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708843.253160:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68674ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708843.253193:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789708843.253195:0:14346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789708843.253229:0:14346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68674ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708843.253253:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b400/0xa8f741d1c68674c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c30 expref: 8 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708843.253270:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68674ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c30 expref: 7 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708843.253278:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:2.0:1789708843.253281:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708843.253284:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6b200, rc 0) 00000100:00100000:2.0:1789708843.253349:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+7:13764:x1876645415854208:12345-192.168.202.53@tcp:101:mkdir.0 Request processed in 359us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708843.253356:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00010000:00010000:0.0:1789708843.904496:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789708844.396450:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7 00010000:00010000:0.0:1789708844.922974:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708845.276903:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708845.277391:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415854336 00000100:00100000:2.0:1789708845.277402:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415854336 00000100:00100000:2.0:1789708845.277490:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:2.0:1789708845.277501:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+7:13816:x1876645415854336:12345-192.168.202.53@tcp:41:lfs.0 00000004:00000024:2.0:1789708845.277553:0:14344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789708845.277702:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+7:13816:x1876645415854336:12345-192.168.202.53@tcp:41:lfs.0 Request processed in 203us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708845.277712:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00080000:1.0:1789708845.278104:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789708845.286948:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708845.287270:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415854464 00000100:00100000:1.0:1789708845.287281:0:15033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415854464 00000100:00100000:1.0:1789708845.287364:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:1.0:1789708845.287374:0:15033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+5:13816:x1876645415854464:12345-192.168.202.53@tcp:13:lfs.0 00002000:00000024:1.0:1789708845.287413:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708845.287499:0:15033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+5:13816:x1876645415854464:12345-192.168.202.53@tcp:13:lfs.0 Request processed in 126us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708845.287507:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00080000:3.0:1789708845.289828:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708845.295089:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708845.295200:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415854592 00000100:00100000:1.0:1789708845.295224:0:15033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415854592 00000100:00100000:1.0:1789708845.295300:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:1.0:1789708845.295311:0:15033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:13816:x1876645415854592:12345-192.168.202.53@tcp:13:lfs.0 00002000:00000024:1.0:1789708845.295353:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708845.295494:0:15033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:13816:x1876645415854592:12345-192.168.202.53@tcp:13:lfs.0 Request processed in 185us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708845.295502:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00080000:3.0:1789708845.295786:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789708845.308235:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426323584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708845.308317:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708845.308463:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426323584 00000100:00100000:1.0:1789708845.308471:0:15033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426323584 00000100:00100000:1.0:1789708845.308535:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789708845.308544:0:15033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426323584:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789708845.308762:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789708845.308831:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708845.308890:0:15033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426323584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 346us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708845.308898:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789708845.308984:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426323584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789708845.499211:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708845.500530:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415854720 00000100:00100000:2.0:1789708845.500542:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415854720 00000100:00100000:2.0:1789708845.500675:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 91 00000100:00100000:2.0:1789708845.500688:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+10:13848:x1876645415854720:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789708845.500707:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708845.500729:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1403b6b400/0xa8f741d1c68674d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4c37 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708845.500764:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1403b6b400/0xa8f741d1c68674d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c37 expref: 11 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708845.500775:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1403b6b400/0xa8f741d1c68674d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c37 expref: 11 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708845.500785:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6b400, rc 0) 00000100:00100000:2.0:1789708845.500919:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+11:13848:x1876645415854720:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 233us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708845.500927:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 91 00000100:00100000:0.0:1789708845.507429:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708845.507741:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415854848 00000100:00100000:3.0:1789708845.507769:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415854848 00000100:00100000:3.0:1789708845.507893:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 92 00000100:00100000:3.0:1789708845.507904:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+11:13848:x1876645415854848:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789708845.509705:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+11:13848:x1876645415854848:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 1792us (2275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708845.509719:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 92 00000100:00100000:3.0:1789708845.520966:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708845.522571:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415854976 00000100:00100000:0.0:1789708845.522594:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415854976 00000100:00100000:0.0:1789708845.522691:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 93 00000100:00100000:0.0:1789708845.522710:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+11:13848:x1876645415854976:12345-192.168.202.53@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789708845.523041:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434664850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+11:13848:x1876645415854976:12345-192.168.202.53@tcp:503:mount.lustre.0 Request processed in 341us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708845.523404:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 93 00000100:00100000:0.0:1789708845.552033:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708845.559465:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415855104 00000100:00100000:3.0:1789708845.559484:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415855104 00000100:00100000:3.0:1789708845.559737:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 94 00000100:00100000:3.0:1789708845.559750:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+11:13855:x1876645415855104:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789708845.560177:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+11:13855:x1876645415855104:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 429us (8152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708845.560186:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 94 00000100:00100000:3.0:1789708845.604544:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708845.610130:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415855232 00000100:00100000:0.0:1789708845.610147:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415855232 00000100:00100000:0.0:1789708845.610230:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 95 00000100:00100000:0.0:1789708845.610364:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+11:13855:x1876645415855232:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789708845.610759:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+11:13855:x1876645415855232:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 396us (6222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708845.616734:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708845.619452:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415855360 00000100:00100000:2.0:1789708845.619475:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415855360 00000100:00100000:2.0:1789708845.619534:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 96 00000100:00100000:2.0:1789708845.619544:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+12:13848:x1876645415855360:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789708845.619586:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708845.619606:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1403b6ae00/0xa8f741d1c68674d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4c61 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708845.619633:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1403b6ae00/0xa8f741d1c68674d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c61 expref: 13 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708845.619643:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1403b6ae00/0xa8f741d1c68674d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c61 expref: 13 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708845.619671:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6ae00, rc 0) 00000100:00100000:2.0:1789708845.619744:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:13848:x1876645415855360:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 201us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708845.619750:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 96 00000100:00100000:0.0:1789708845.620748:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 95 00000100:00100000:3.0:1789708845.625606:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708845.625718:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415855488 00000100:00100000:2.0:1789708845.625730:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415855488 00000100:00100000:2.0:1789708845.625792:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 97 00000100:00100000:2.0:1789708845.625802:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+12:13848:x1876645415855488:12345-192.168.202.53@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789708845.625826:0:14337:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789708845.625851:0:14337:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789708845.625855:0:14337:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789708845.625858:0:14337:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789708845.625861:0:14337:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789708845.628092:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+12:13848:x1876645415855488:12345-192.168.202.53@tcp:256:mount.lustre.0 Request processed in 2129us (2335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708845.628106:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 97 00000100:00100000:3.0:1789708845.630792:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708845.631737:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415855616 00000100:00100000:0.0:1789708845.631751:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415855616 00000100:00100000:0.0:1789708845.631824:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 98 00000100:00100000:0.0:1789708845.631835:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+12:13848:x1876645415855616:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789708845.631855:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708845.631876:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a14014a9c00/0xa8f741d1c68674df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4c68 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708845.631910:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a14014a9c00/0xa8f741d1c68674df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c68 expref: 13 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708845.631922:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a14014a9c00/0xa8f741d1c68674df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c68 expref: 13 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708845.631932:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14014a9c00, rc 0) 00000100:00100000:0.0:1789708845.632282:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:13848:x1876645415855616:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 169us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708845.632307:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 98 00000100:00100000:3.0:1789708845.633677:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708845.634252:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415855744 00000100:00100000:2.0:1789708845.634274:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415855744 00000100:00100000:1.0:1789708845.634432:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 99 00000100:00100000:1.0:1789708845.634455:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:13848:x1876645415855744:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789708845.634800:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:13848:x1876645415855744:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 358us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708845.634808:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 99 00000100:00100000:3.0:1789708845.636358:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708845.636444:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415855872 00000100:00100000:0.0:1789708845.636452:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415855872 00000100:00100000:0.0:1789708845.636929:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 100 00000100:00100000:0.0:1789708845.636942:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:13848:x1876645415855872:12345-192.168.202.53@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789708845.637298:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:13848:x1876645415855872:12345-192.168.202.53@tcp:503:mount.lustre.0 Request processed in 358us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708845.637306:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 100 00000100:00100000:3.0:1789708845.639615:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708845.639802:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415856000 00000100:00100000:2.0:1789708845.639813:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415856000 00000100:00100000:2.0:1789708845.640007:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 101 00000100:00100000:2.0:1789708845.640020:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:13862:x1876645415856000:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789708845.640337:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:13862:x1876645415856000:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 318us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708845.640345:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 101 00000100:00100000:3.0:1789708845.643551:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708845.649282:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415856128 00000100:00100000:1.0:1789708845.649298:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415856128 00000100:00100000:1.0:1789708845.649364:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 102 00000100:00100000:1.0:1789708845.649373:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:13862:x1876645415856128:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789708845.649697:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:13862:x1876645415856128:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 323us (6156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708845.649712:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 102 00000100:00100000:3.0:1789708845.656970:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708845.657100:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415856256 00000100:00100000:2.0:1789708845.657112:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415856256 00000100:00100000:2.0:1789708845.657172:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:2.0:1789708845.657181:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1876645415856256:12345-192.168.202.53@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789708845.657216:0:14346:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7a2dd95b-f0e7-4239-8480-4d058ec34c66@192.168.202.53@tcp t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:2.0:1789708845.657273:0:14346:0:(genops.c:1384:class_connect()) connect: client 7a2dd95b-f0e7-4239-8480-4d058ec34c66, cookie 0xa8f741d1c68674e6 00000004:00100000:2.0:1789708845.657306:0:14346:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789708845.657434:0:14346:0:(import.c:65:import_set_state_nolock()) ffff8a130592e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789708845.657515:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:2360:x1876645415856256:12345-192.168.202.53@tcp:38:mount.lustre.0 Request processed in 333us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708845.657524:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:3.0:1789708845.673490:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708845.673527:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708845.673920:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415856384 00000100:00100000:0.0:1789708845.673930:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415856384 00000100:00100000:2.0:1789708845.674070:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415856512 00000100:00100000:2.0:1789708845.674075:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415856512 00000100:00100000:2.0:1789708845.674136:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:2.0:1789708845.674147:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a2dd95b-f0e7-4239-8480-4d058ec34c66+7:13848:x1876645415856512:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789708845.674181:0:14344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789708845.674264:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a2dd95b-f0e7-4239-8480-4d058ec34c66+7:13848:x1876645415856512:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 117us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708845.674289:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:0.0:1789708845.674537:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:0.0:1789708845.674545:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:0:x1876645415856384:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789708845.674558:0:14345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789708845.674598:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:0:x1876645415856384:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 55us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708845.674604:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00080000:3.0:1789708845.677633:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708845.677906:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708845.678026:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415856640 00000100:00100000:2.0:1789708845.678036:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415856640 00000100:00100000:2.0:1789708845.679251:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:2.0:1789708845.679265:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:13848:x1876645415856640:12345-192.168.202.53@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789708845.679424:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:13848:x1876645415856640:12345-192.168.202.53@tcp:40:mount.lustre.0 Request processed in 161us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708845.679432:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:3.0:1789708845.682554:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708845.682798:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708845.682835:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708845.682866:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415856768 00000100:00100000:3.0:1789708845.682876:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415856768 00000100:00100000:3.0:1789708845.682915:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415856896 00000100:00100000:3.0:1789708845.682918:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415856896 00000100:00100000:3.0:1789708845.682935:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:3.0:1789708845.682943:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1876645415856768:12345-192.168.202.53@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789708845.682976:0:15031:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7a2dd95b-f0e7-4239-8480-4d058ec34c66@192.168.202.53@tcp t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:3.0:1789708845.683015:0:15031:0:(genops.c:1384:class_connect()) connect: client 7a2dd95b-f0e7-4239-8480-4d058ec34c66, cookie 0xa8f741d1c68674ed 00002000:00100000:3.0:1789708845.683027:0:15031:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7a2dd95b-f0e7-4239-8480-4d058ec34c66/ffff8a13033e7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789708845.683053:0:15031:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789708845.683543:0:15031:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789708845.683612:0:15031:0:(import.c:65:import_set_state_nolock()) ffff8a1426d65800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708845.683702:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:2360:x1876645415856768:12345-192.168.202.53@tcp:8:mount.lustre.0 Request processed in 757us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708845.683711:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:3.0:1789708845.683734:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:3.0:1789708845.683738:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1876645415856896:12345-192.168.202.53@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789708845.683755:0:15031:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7a2dd95b-f0e7-4239-8480-4d058ec34c66@192.168.202.53@tcp t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:3.0:1789708845.683773:0:15031:0:(genops.c:1384:class_connect()) connect: client 7a2dd95b-f0e7-4239-8480-4d058ec34c66, cookie 0xa8f741d1c68674f4 00002000:00100000:3.0:1789708845.683779:0:15031:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7a2dd95b-f0e7-4239-8480-4d058ec34c66/ffff8a1426d60000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789708845.683785:0:15031:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789708845.683836:0:15031:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789708845.683858:0:15031:0:(import.c:65:import_set_state_nolock()) ffff8a1426d60800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789708845.683882:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:2360:x1876645415856896:12345-192.168.202.53@tcp:8:mount.lustre.0 Request processed in 142us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708845.683889:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:1.0:1789708845.685886:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415857024 00000100:00100000:1.0:1789708845.685900:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415857024 00000100:00100000:1.0:1789708845.686006:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:1.0:1789708845.686017:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:13848:x1876645415857024:12345-192.168.202.53@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789708845.686113:0:14348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789708845.686198:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:13848:x1876645415857024:12345-192.168.202.53@tcp:33:mount.lustre.0 Request processed in 183us (3654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708845.686206:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:3.0:1789708845.889483:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708845.889896:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415857152 00000100:00100000:0.0:1789708845.889909:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415857152 00000100:00100000:0.0:1789708845.889979:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:0.0:1789708845.889991:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:13883:x1876645415857152:12345-192.168.202.53@tcp:101:mkdir.0 00010000:00010000:0.0:1789708845.890018:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708845.890362:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c68674fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4c92 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708845.890453:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9400/0xa8f741d1c6867502 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708845.890468:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9400/0xa8f741d1c6867502 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708845.890482:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9400/0xa8f741d1c6867502 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708845.890520:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789708845.890525:0:14345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789708845.890547:0:14345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9400/0xa8f741d1c6867502 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708845.890586:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c68674fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c92 expref: 8 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708845.890607:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9400/0xa8f741d1c6867502 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c92 expref: 7 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708845.890617:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:0.0:1789708845.890620:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708845.890624:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14014a9400, rc 0) 00000100:00100000:0.0:1789708845.891520:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+7:13883:x1876645415857152:12345-192.168.202.53@tcp:101:mkdir.0 Request processed in 1524us (2044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708845.891531:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00010000:00010000:0.0:1789708845.949466:0:15969:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789708846.459277:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789708846.970813:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789708847.867032:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426323840:0@lo:400:kworker.0 00000100:00100000:2.0:1789708847.867117:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708847.867153:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426323968:0@lo:400:kworker.0 00000100:00100000:2.0:1789708847.867181:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426324480:0@lo:400:kworker.0 00000100:00100000:1.0:1789708847.867194:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708847.867221:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708847.867243:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434b94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426324352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708847.867253:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789708847.867263:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdca603d-b230-4a0c-9898-90b77d1d9d18:3289:1876645426323712:0@lo:400:kworker.0 00000100:00100000:1.0:1789708847.867276:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708847.867852:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426324352 00000100:00100000:0.0:1789708847.867864:0:15033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426324352 00000100:00100000:0.0:1789708847.867928:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789708847.867939:0:15033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426324352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789708847.867977:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789708847.870288:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426324480 00000100:00100000:3.0:1789708847.870303:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426324480 00000100:00100000:3.0:1789708847.870370:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789708847.870383:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426324480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708847.872470:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789708847.872490:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426324096:0@lo:400:kworker.0 00000100:00100000:1.0:1789708847.872569:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708847.872612:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426324096 00000100:00100000:1.0:1789708847.872620:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426324096 00000100:00100000:1.0:1789708847.872686:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789708847.872696:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426324096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708847.872753:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876645426324096:12345-0@lo:400:kworker.0 Request processed in 58us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708847.872761:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789708847.872806:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876645426324096:0@lo:400:kworker.0 00000100:00080000:1.0:1789708847.872871:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789708847.872879:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708847.872892:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426323840 00000100:00100000:1.0:1789708847.872897:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426323840 00000100:00100000:1.0:1789708847.872930:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426323968 00000100:00100000:1.0:1789708847.872933:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426323968 00000100:00100000:1.0:1789708847.872947:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789708847.872953:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426323840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708847.872992:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426323840:12345-0@lo:400:kworker.0 Request processed in 39us (5877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708847.872999:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789708847.873010:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789708847.873016:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1876645426323968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789708847.874370:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1876645426323968:12345-0@lo:400:kworker.0 Request processed in 1346us (7169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708847.874383:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789708847.874420:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789708847.874465:0:3286:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789708847.874483:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426323968:0@lo:400:kworker.0 00000100:00100000:2.0:1789708847.875390:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708847.875436:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426323712 00000100:00100000:2.0:1789708847.875444:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426323712 00000100:00100000:2.0:1789708847.875488:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789708847.875497:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:3289:x1876645426323712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708847.875577:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:3289:x1876645426323712:12345-0@lo:400:kworker.0 Request processed in 81us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708847.875584:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789708847.875638:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdca603d-b230-4a0c-9898-90b77d1d9d18:3289:1876645426323712:0@lo:400:kworker.0 00000100:00100000:2.0:1789708847.875676:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876645426324224:0@lo:400:kworker.0 00000100:00100000:2.0:1789708847.875712:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708847.875737:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426324224 00000100:00100000:2.0:1789708847.875741:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426324224 00000100:00100000:2.0:1789708847.875777:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789708847.875784:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876645426324224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708847.875815:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1876645426324224:12345-0@lo:400:kworker.0 Request processed in 32us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708847.875822:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789708847.875837:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708847.875861:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1876645426324224:0@lo:400:kworker.0 00000100:00100000:2.0:1789708847.875877:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426323840:0@lo:400:kworker.0 00000100:00100000:0.0:1789708847.884980:0:15033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426324352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 17033us (17693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708847.884997:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789708847.885790:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434b94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426324352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789708847.886240:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1876645426324480:12345-0@lo:400:kworker.0 Request processed in 15858us (19017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708847.886253:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789708847.886829:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1876645426324480:0@lo:400:kworker.0 00000001:00100000:0.0:1789708847.949094:0:5841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7a2dd95b-f0e7-4239-8480-4d058ec34c66 00000001:00100000:0.0:1789708847.949109:0:5841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7 00000001:00100000:3.0:1789708847.957995:0:7627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a2dd95b-f0e7-4239-8480-4d058ec34c66 00000001:00100000:3.0:1789708847.958009:0:7627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7 00010000:00010000:0.0:1789708847.994849:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708849.019041:0:15969:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789708849.455681:0:16313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1789708849.466462:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a2dd95b-f0e7-4239-8480-4d058ec34c66 00010000:00010000:0.0:1789708850.042866:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708850.433749:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426324608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708850.433844:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708850.434067:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426324608 00000100:00100000:1.0:1789708850.434077:0:15034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426324608 00000100:00100000:1.0:1789708850.434143:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789708850.434153:0:15034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426324608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789708850.434193:0:15034:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708850.434244:0:15034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426324608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708850.434265:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789708850.435400:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708850.435529:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426324608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708850.942576:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708850.942789:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415857408 00000100:00100000:2.0:1789708850.942801:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415857408 00000100:00100000:2.0:1789708850.942873:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:2.0:1789708850.942883:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:2362:x1876645415857408:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708850.942969:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:2362:x1876645415857408:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 87us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708850.942978:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00080000:1.0:1789708850.943143:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708850.953257:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708850.953335:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708850.959362:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708850.959397:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708850.961550:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415857664 00000100:00100000:1.0:1789708850.961569:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415857664 00000100:00100000:1.0:1789708850.961669:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415857920 00000100:00100000:1.0:1789708850.961673:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415857920 00000100:00100000:1.0:1789708850.961704:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:1.0:1789708850.961715:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+5:2362:x1876645415857664:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708850.961824:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+5:2362:x1876645415857664:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 110us (8577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708850.961833:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:1.0:1789708850.961852:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:1.0:1789708850.961859:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a2dd95b-f0e7-4239-8480-4d058ec34c66+5:2362:x1876645415857920:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1789708850.961885:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a2dd95b-f0e7-4239-8480-4d058ec34c66+5:2362:x1876645415857920:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 26us (8549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708850.961891:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00080000:1.0:1789708850.961915:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789708850.961919:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708850.962815:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708850.962882:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708850.962908:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415857280 00000100:00100000:2.0:1789708850.962914:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415857280 00000100:00100000:2.0:1789708850.962949:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 104 00000100:00100000:2.0:1789708850.962957:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:2362:x1876645415857280:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708850.963017:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:2362:x1876645415857280:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 60us (3667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708850.963025:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 104 00000100:00100000:2.0:1789708850.963065:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415857536 00000100:00100000:2.0:1789708850.963069:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415857536 00000100:00100000:2.0:1789708850.963096:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415858048 00000100:00100000:2.0:1789708850.963099:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415858048 00000100:00100000:2.0:1789708850.963114:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:2.0:1789708850.963120:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+5:2362:x1876645415857536:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708850.963149:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+5:2362:x1876645415857536:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 28us (3751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708850.963155:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:2.0:1789708850.963167:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:2.0:1789708850.963173:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+5:2362:x1876645415858048:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708850.963934:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+5:2362:x1876645415858048:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 757us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708850.963944:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00080000:2.0:1789708850.963965:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789708850.963968:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708850.964421:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415857792 00000100:00100000:3.0:1789708850.964427:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415857792 00000100:00100000:3.0:1789708850.964482:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:3.0:1789708850.964489:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:2362:x1876645415857792:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708850.964542:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:2362:x1876645415857792:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 53us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708850.964549:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00080000:2.0:1789708850.966872:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789708851.069002:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789708852.097122:0:15969:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708852.989441:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789708852.989462:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130a5aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426324736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789708852.989551:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708852.989820:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426324736 00000100:00100000:1.0:1789708852.989828:0:15034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426324736 00000100:00100000:1.0:1789708852.989880:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789708852.989889:0:15034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426324736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789708852.989919:0:15034:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708852.989967:0:15034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426324736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708852.990001:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789708852.990032:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789708852.990069:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130a5aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426324736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789708852.993915:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876645426325120:0@lo:400:kworker.0 00000100:00100000:3.0:1789708852.994001:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708852.994046:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789708852.994052:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426324992:0@lo:400:kworker.0 00000100:00100000:3.0:1789708852.994079:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708852.994959:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426325120 00000100:00100000:2.0:1789708852.994979:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426325120 00000100:00100000:2.0:1789708852.995030:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789708852.995040:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876645426325120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708852.995107:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876645426325120:12345-0@lo:400:kworker.0 Request processed in 68us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708852.995115:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789708852.995163:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876645426325120:0@lo:400:kworker.0 00000100:00100000:2.0:1789708852.995924:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426325248:0@lo:400:kworker.0 00000100:00100000:2.0:1789708852.995980:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708852.996012:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789708852.996019:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a130a5aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdca603d-b230-4a0c-9898-90b77d1d9d18:3288:1876645426324864:0@lo:400:kworker.0 00000100:00100000:2.0:1789708852.996049:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708852.996076:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876645426325376:0@lo:400:kworker.0 00000100:00100000:2.0:1789708852.996097:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708852.996126:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426325248 00000100:00100000:2.0:1789708852.996131:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426325248 00000100:00100000:2.0:1789708852.996173:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426325376 00000100:00100000:2.0:1789708852.996176:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426325376 00000100:00100000:2.0:1789708852.996197:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789708852.996205:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426325248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708852.996251:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1876645426325248:12345-0@lo:400:kworker.0 Request processed in 47us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708852.996260:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789708852.996274:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789708852.996280:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876645426325376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708852.996323:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1876645426325376:12345-0@lo:400:kworker.0 Request processed in 43us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708852.996330:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789708852.996348:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426324864 00000100:00100000:2.0:1789708852.996352:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426324864 00000100:00100000:2.0:1789708852.996375:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789708852.996381:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:3288:x1876645426324864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708852.996408:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:3288:x1876645426324864:12345-0@lo:400:kworker.0 Request processed in 27us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708852.996413:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789708852.996461:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a130a5aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdca603d-b230-4a0c-9898-90b77d1d9d18:3288:1876645426324864:0@lo:400:kworker.0 00000100:00100000:2.0:1789708852.996473:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1876645426325376:0@lo:400:kworker.0 00000100:00100000:2.0:1789708852.996481:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1876645426325248:0@lo:400:kworker.0 00000100:00080000:0.0:1789708853.001111:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708853.001140:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426324992 00000100:00100000:0.0:1789708853.001152:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426324992 00000100:00100000:0.0:1789708853.001223:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789708853.001234:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426324992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708853.001328:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426324992:12345-0@lo:400:kworker.0 Request processed in 96us (7248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708853.001335:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789708853.001354:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708853.006776:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426324992:0@lo:400:kworker.0 00010000:00010000:1.0:1789708853.118717:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789708853.325981:0:16463:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2a6eaa90 20000000:00000080:2.0:1789708853.325998:0:16463:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a130ab49400 uarg=0000000000000000 20000000:01000000:2.0:1789708853.326038:0:16463:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789708853.326044:0:16463:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789708853.326049:0:16463:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789708853.326620:0:16464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1789708853.326999:0:16463:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789708853.331079:0:16463:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789708853.331386:0:16463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a143fa39800/0xa8f741d1c6867509 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708853.331408:0:16463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1426d23c00/0xa8f741d1c6867200 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c68671f9 expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708853.331417:0:16463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a143efc4e00/0xa8f741d1c686724d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6867246 expref: 18 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708853.331425:0:16463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1403b6a600/0xa8f741d1c6867388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c6867381 expref: 18 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708853.331435:0:16463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1414ed8200/0xa8f741d1c68674a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c06 expref: 12 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708853.331442:0:16463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a14014a9c00/0xa8f741d1c68674df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c68 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708853.331450:0:16463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a143fa39800/0xa8f741d1c6867509 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708853.331495:0:16463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a14014a9c00/0xa8f741d1c68674df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c68 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708853.331536:0:16463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a14014a9c00/0xa8f741d1c68674df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c68 expref: 12 pid: 14338 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708853.331550:0:16463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16463:1876645426325504:192.168.202.53@tcp:104: 00010000:00010000:3.0:1789708853.331709:0:16463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1414ed8200/0xa8f741d1c68674a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c06 expref: 12 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708853.331718:0:16463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1414ed8200/0xa8f741d1c68674a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c06 expref: 12 pid: 14339 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708853.331727:0:16463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16463:1876645426325632:192.168.202.53@tcp:104: 00010000:00010000:3.0:1789708853.331755:0:16463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1403b6a600/0xa8f741d1c6867388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6867381 expref: 18 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708853.331763:0:16463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1403b6a600/0xa8f741d1c6867388 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6867381 expref: 18 pid: 14339 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708853.331772:0:16463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a14344c2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16463:1876645426325760:0@lo:104: 00000100:00100000:3.0:1789708853.331811:0:16463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708853.331845:0:16463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a143efc4e00/0xa8f741d1c686724d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c6867246 expref: 18 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708853.331853:0:16463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a143efc4e00/0xa8f741d1c686724d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c6867246 expref: 18 pid: 14339 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708853.331861:0:16463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e959c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16463:1876645426325888:0@lo:104: 00000100:00100000:3.0:1789708853.331879:0:16463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789708853.331909:0:16463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1426d23c00/0xa8f741d1c6867200 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa8f741d1c68671f9 expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708853.331917:0:16463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1426d23c00/0xa8f741d1c6867200 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa8f741d1c68671f9 expref: 18 pid: 14338 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708853.331925:0:16463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e959880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16463:1876645426326016:0@lo:104: 00000100:00100000:3.0:1789708853.331948:0:16463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708853.331958:0:16463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a141095c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789708853.332075:0:14327:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789708853.332088:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426325760 00000100:00100000:0.0:1789708853.332095:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426325760 00000100:00100000:0.0:1789708853.332128:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426325888 00000100:00100000:0.0:1789708853.332135:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426325888 00000100:00100000:0.0:1789708853.332145:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426326016 00000100:00100000:0.0:1789708853.332146:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426326016 00000100:00100000:0.0:1789708853.332158:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708853.332166:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdca603d-b230-4a0c-9898-90b77d1d9d18+5:16463:x1876645426325760:12345-0@lo:104: 00010000:00010000:0.0:1789708853.332178:0:14327:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c6867381 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6867388 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.332239:0:14327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789708853.332244:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdca603d-b230-4a0c-9898-90b77d1d9d18+5:16463:x1876645426325760:12345-0@lo:104: Request processed in 80us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708853.332252:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708853.332268:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789708853.332272:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e959180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdca603d-b230-4a0c-9898-90b77d1d9d18+4:16463:x1876645426325888:12345-0@lo:104: 00010000:00010000:0.0:1789708853.332280:0:14327:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1426d23600/0xa8f741d1c6867246 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c686724d expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.332312:0:14327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789708853.332316:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e959180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdca603d-b230-4a0c-9898-90b77d1d9d18+4:16463:x1876645426325888:12345-0@lo:104: Request processed in 44us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708853.332321:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789708853.332332:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789708853.332336:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1403668050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdca603d-b230-4a0c-9898-90b77d1d9d18+3:16463:x1876645426326016:12345-0@lo:104: 00010000:00010000:0.0:1789708853.332342:0:14327:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1426d23800/0xa8f741d1c68671f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6867200 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.332370:0:14327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789708853.332374:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1403668050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cdca603d-b230-4a0c-9898-90b77d1d9d18+3:16463:x1876645426326016:12345-0@lo:104: Request processed in 38us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708853.332386:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789708853.332427:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789708853.332433:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c6867381 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6867388 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.332440:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa38000 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:0.0:1789708853.332445:0:14333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c6867381 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6867388 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.332454:0:14333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c6867381 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6867388 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708853.332461:0:14333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c6867381 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6867388 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708853.332467:0:14333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789708853.332493:0:14333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c6867381 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6867388 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.332499:0:14333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708853.332530:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c6867381 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6867388 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.332537:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c6867381 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6867388 expref: -99 pid: 15747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.332549:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789708853.332552:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1426d23600/0xa8f741d1c6867246 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c686724d expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.332568:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23600 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:0.0:1789708853.332570:0:14333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1426d23600/0xa8f741d1c6867246 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c686724d expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.332577:0:14333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1426d23600/0xa8f741d1c6867246 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c686724d expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708853.332582:0:14333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1426d23600/0xa8f741d1c6867246 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c686724d expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708853.332586:0:14333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789708853.332599:0:14333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1426d23600/0xa8f741d1c6867246 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c686724d expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.332604:0:14333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708853.332610:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1426d23600/0xa8f741d1c6867246 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c686724d expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.332616:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1426d23600/0xa8f741d1c6867246 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c686724d expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.332627:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708853.332630:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1426d23800/0xa8f741d1c68671f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa8f741d1c6867200 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.332635:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1426d23800 already unused, calling callback (ffffffffc1c15d20) 10000000:00010000:0.0:1789708853.332638:0:14333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1426d23800/0xa8f741d1c68671f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa8f741d1c6867200 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.332676:0:14333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1426d23800/0xa8f741d1c68671f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa8f741d1c6867200 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789708853.332682:0:14333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1426d23800/0xa8f741d1c68671f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa8f741d1c6867200 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789708853.332687:0:14333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789708853.332699:0:14333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1426d23800/0xa8f741d1c68671f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6867200 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.332704:0:14333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789708853.332719:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1426d23800/0xa8f741d1c68671f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6867200 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.332726:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1426d23800/0xa8f741d1c68671f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa8f741d1c6867200 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.332738:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708853.332739:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708853.332741:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708853.332747:0:15969:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708853.332751:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708853.332768:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdca603d-b230-4a0c-9898-90b77d1d9d18:3286:1876645426326144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708853.332796:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708853.332819:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789708853.332825:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdca603d-b230-4a0c-9898-90b77d1d9d18:3286:1876645426326272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708853.332842:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708853.332862:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdca603d-b230-4a0c-9898-90b77d1d9d18:3288:1876645426326400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708853.332888:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708853.332919:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426326144 00000100:00100000:0.0:1789708853.332923:0:14331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426326144 00010000:00010000:0.0:1789708853.332938:0:14331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1403b6a600/0xa8f741d1c6867388 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6867381 expref: 19 pid: 14339 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708853.332953:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426326272 00000100:00100000:0.0:1789708853.332956:0:14331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426326272 00010000:00010000:0.0:1789708853.332965:0:14331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a143efc4e00/0xa8f741d1c686724d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6867246 expref: 20 pid: 14339 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708853.332975:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426326400 00000100:00100000:0.0:1789708853.332977:0:14331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426326400 00010000:00010000:0.0:1789708853.332986:0:14331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1426d23c00/0xa8f741d1c6867200 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c68671f9 expref: 21 pid: 14338 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708853.332998:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708853.333005:0:14331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdca603d-b230-4a0c-9898-90b77d1d9d18+21:3286:x1876645426326144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708853.333016:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708853.333021:0:14331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1403b6a600/0xa8f741d1c6867388 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6867381 expref: 21 pid: 14339 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.333029:0:14331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1403b6a600/0xa8f741d1c6867388 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6867381 expref: 21 pid: 14339 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.333045:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708853.333071:0:14331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdca603d-b230-4a0c-9898-90b77d1d9d18+21:3286:x1876645426326144:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708853.333077:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789708853.333089:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789708853.333100:0:14331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdca603d-b230-4a0c-9898-90b77d1d9d18+20:3286:x1876645426326272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708853.333107:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708853.333112:0:14331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a143efc4e00/0xa8f741d1c686724d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c6867246 expref: 20 pid: 14339 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.333121:0:14331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a143efc4e00/0xa8f741d1c686724d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c6867246 expref: 20 pid: 14339 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.333129:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708853.333146:0:14331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdca603d-b230-4a0c-9898-90b77d1d9d18+20:3286:x1876645426326272:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708853.333152:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789708853.333162:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789708853.333167:0:14331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1a7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:3288:x1876645426326400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789708853.333173:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708853.333176:0:14331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1426d23c00/0xa8f741d1c6867200 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa8f741d1c68671f9 expref: 19 pid: 14338 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.333184:0:14331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1426d23c00/0xa8f741d1c6867200 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa8f741d1c68671f9 expref: 19 pid: 14338 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.333192:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708853.333210:0:14331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1a7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:3288:x1876645426326400:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708853.333215:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789708853.333263:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdca603d-b230-4a0c-9898-90b77d1d9d18:3288:1876645426326400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708853.333279:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdca603d-b230-4a0c-9898-90b77d1d9d18:3286:1876645426326272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789708853.333285:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdca603d-b230-4a0c-9898-90b77d1d9d18:3286:1876645426326144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789708853.333577:0:16463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1403b6a600/0xa8f741d1c6867388 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6867381 expref: 18 pid: 14339 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708853.333588:0:16463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16463:1876645426325760:0@lo:104: 00010000:00010000:3.0:1789708853.333599:0:16463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143efc4e00/0xa8f741d1c686724d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c6867246 expref: 17 pid: 14339 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708853.333606:0:16463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e959c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16463:1876645426325888:0@lo:104: 00010000:00010000:3.0:1789708853.333614:0:16463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1426d23c00/0xa8f741d1c6867200 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa8f741d1c68671f9 expref: 16 pid: 14338 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708853.333622:0:16463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e959880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16463:1876645426326016:0@lo:104: 00000100:00100000:2.0:1789708853.337252:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708853.337291:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708853.337466:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415858304 00000100:00100000:0.0:1789708853.337477:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415858304 00010000:00010000:0.0:1789708853.337527:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1414ed8200/0xa8f741d1c68674a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c06 expref: 13 pid: 14339 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708853.337560:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415858176 00000100:00100000:0.0:1789708853.337563:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415858176 00010000:00010000:0.0:1789708853.337574:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a14014a9c00/0xa8f741d1c68674df lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c68 expref: 14 pid: 14338 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708853.337583:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:0.0:1789708853.337589:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427033480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+14:2361:x1876645415858304:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708853.337603:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708853.337606:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1414ed8200/0xa8f741d1c68674a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c06 expref: 14 pid: 14339 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.337614:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1414ed8200/0xa8f741d1c68674a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c06 expref: 14 pid: 14339 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.337633:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708853.337720:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427033480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+14:2361:x1876645415858304:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 129us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708853.337727:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:0.0:1789708853.337747:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:0.0:1789708853.337753:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:2361:x1876645415858176:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708853.337760:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708853.337765:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a14014a9c00/0xa8f741d1c68674df lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c68 expref: 13 pid: 14338 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.337793:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a14014a9c00/0xa8f741d1c68674df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c68 expref: 13 pid: 14338 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.337806:0:14329:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a143fa39800/0xa8f741d1c6867509 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.337815:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa39800/0xa8f741d1c6867509 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.337830:0:14329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a143fa39800/0xa8f741d1c6867509 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.337837:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a143fa39800/0xa8f741d1c6867509 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.337845:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a143fa39800/0xa8f741d1c6867509 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.337851:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a143fa39800/0xa8f741d1c6867509 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.337857:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143fa39800 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708853.337862:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a143fa39800/0xa8f741d1c6867509 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.337869:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a143fa39800/0xa8f741d1c6867509 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.337878:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a143fa39800/0xa8f741d1c6867509 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708853.337901:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708853.337917:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:2361:x1876645415858176:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 165us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708853.337922:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00010000:00010000:1.0:1789708853.338412:0:16463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a14014a9c00/0xa8f741d1c68674df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c68 expref: 12 pid: 14338 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708853.338428:0:16463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16463:1876645426325504:192.168.202.53@tcp:104: 00010000:00010000:1.0:1789708853.338440:0:16463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1414ed8200/0xa8f741d1c68674a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c06 expref: 11 pid: 14339 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708853.338447:0:16463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a14344c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16463:1876645426325632:192.168.202.53@tcp:104: 00010000:00010000:1.0:1789708853.338475:0:16463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a143fa39800/0xa8f741d1c6867509 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708853.338484:0:16463:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a143fa39800/0xa8f741d1c6867509 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708853.338489:0:16463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a143fa39800/0xa8f741d1c6867509 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708853.338495:0:16463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a143fa39800/0xa8f741d1c6867509 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708854.138973:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708854.652293:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708854.652882:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415858432 00000100:00100000:3.0:1789708854.652895:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415858432 00000100:00100000:3.0:1789708854.652965:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 106 00000100:00100000:3.0:1789708854.652976:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+11:13736:x1876645415858432:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708854.652994:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708854.653017:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa38400/0xa8f741d1c6867510 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4c99 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708854.653065:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa38400/0xa8f741d1c6867510 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c99 expref: 12 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708854.653076:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa38400/0xa8f741d1c6867510 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c99 expref: 12 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708854.653084:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38400, rc 0) 00000100:00100000:3.0:1789708854.653149:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+12:13736:x1876645415858432:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 176us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708854.653157:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 106 00000100:00100000:3.0:1789708854.655429:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708854.655521:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415858560 00000100:00100000:1.0:1789708854.655530:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415858560 00000100:00100000:1.0:1789708854.655588:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 107 00000100:00100000:1.0:1789708854.655598:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+12:13736:x1876645415858560:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789708854.655920:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+12:13736:x1876645415858560:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 323us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708854.655929:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 107 00000100:00100000:1.0:1789708854.661028:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708854.661176:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415858688 00000100:00100000:0.0:1789708854.661187:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415858688 00000100:00100000:0.0:1789708854.661243:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 108 00000100:00100000:0.0:1789708854.661254:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+12:13736:x1876645415858688:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708854.661482:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+12:13736:x1876645415858688:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 Request processed in 230us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708854.661502:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 108 00000100:00100000:0.0:1789708854.699058:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708854.699354:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415858816 00000100:00100000:3.0:1789708854.699365:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415858816 00000100:00100000:3.0:1789708854.699418:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 109 00000100:00100000:3.0:1789708854.699429:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1306d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+12:13736:x1876645415858816:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708854.699448:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708854.699478:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa38a00/0xa8f741d1c6867517 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4ca0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708854.699517:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa38a00/0xa8f741d1c6867517 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ca0 expref: 13 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708854.699528:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa38a00/0xa8f741d1c6867517 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ca0 expref: 13 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708854.699537:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa38a00, rc 0) 00000100:00100000:3.0:1789708854.699596:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1306d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:13736:x1876645415858816:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 168us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708854.699609:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 109 00000100:00100000:0.0:1789708854.710102:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708854.710138:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415858944 00000100:00100000:3.0:1789708854.710148:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415858944 00000100:00100000:3.0:1789708854.710203:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 110 00000100:00100000:3.0:1789708854.710213:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:13736:x1876645415858944:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708854.710487:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:13736:x1876645415858944:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 274us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708854.710506:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 110 00000100:00100000:3.0:1789708854.714303:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708854.714467:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415859072 00000100:00100000:0.0:1789708854.714477:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415859072 00000100:00100000:0.0:1789708854.714544:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 111 00000100:00100000:0.0:1789708854.714556:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:13736:x1876645415859072:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789708854.714822:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:13736:x1876645415859072:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 Request processed in 267us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708854.714831:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 111 10000000:01000000:2.0:1789708855.104060:0:14341:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789708855.104069:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1404166000 from 10 10000000:01000000:2.0:1789708855.104094:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789708855.104142:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a000/0xa8f741d1c686751e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708855.104155:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a000/0xa8f741d1c686751e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708855.104168:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a000/0xa8f741d1c686751e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708855.104195:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427030e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426326528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789708855.104270:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708855.104375:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308543240 going to sleep for 11 seconds 00000100:00100000:3.0:1789708855.113898:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426326528 00000100:00100000:3.0:1789708855.113914:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426326528 00000100:00100000:3.0:1789708855.119928:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789708855.119942:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+16:14341:x1876645426326528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708855.119973:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708855.119993:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143fa39800/0xa8f741d1c6867525 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c686751e expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708855.120023:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143fa39800/0xa8f741d1c6867525 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c686751e expref: 17 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708855.120033:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143fa39800/0xa8f741d1c6867525 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686751e expref: 17 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708855.120043:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143fa39800, rc 0) 00000100:00100000:3.0:1789708855.120117:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+17:14341:x1876645426326528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (15847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708855.120124:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789708855.120536:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427030e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426326528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789708855.120556:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a000/0xa8f741d1c686751e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867525 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708855.120565:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a000/0xa8f741d1c686751e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6867525 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708855.120635:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427030e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426326656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789708855.120814:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708855.120842:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308543240 going to sleep for 11 seconds 00000100:00100000:3.0:1789708855.121601:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426326656 00000100:00100000:3.0:1789708855.121609:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426326656 00000100:00100000:3.0:1789708855.121663:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789708855.121672:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+17:14341:x1876645426326656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708855.121927:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+17:14341:x1876645426326656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708855.121936:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789708855.122013:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427030e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426326656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708855.122061:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e958e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426326784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708855.122113:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708855.122126:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a141095c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789708855.122138:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426326784 00000100:00100000:3.0:1789708855.122141:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426326784 00000100:00100000:3.0:1789708855.122164:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789708855.122171:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+17:14341:x1876645426326784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708855.122308:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+17:14341:x1876645426326784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708855.122315:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789708855.122350:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e958e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426326784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789708855.122969:0:16536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789708855.123024:0:14341:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789708855.123049:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789708855.123058:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a000/0xa8f741d1c686751e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867525 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708855.123068:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1403b6a000/0xa8f741d1c686751e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867525 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789708855.123085:0:14341:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789708855.123087:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1434bf8000 from 10 10000000:01000000:3.0:1789708855.123090:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789708855.123114:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c686752c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708855.123121:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c686752c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708855.123132:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c686752c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708855.123148:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e958e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426326912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789708855.123181:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708855.123195:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a141095c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789708855.123208:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426326912 00000100:00100000:3.0:1789708855.123211:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426326912 00000100:00100000:3.0:1789708855.123236:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789708855.123243:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+17:14341:x1876645426326912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708855.123254:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708855.123266:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a143efc4e00/0xa8f741d1c6867533 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c686752c expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708855.123286:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a143efc4e00/0xa8f741d1c6867533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c686752c expref: 18 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708855.123297:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a143efc4e00/0xa8f741d1c6867533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686752c expref: 18 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708855.123317:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4e00, rc 0) 00000100:00100000:3.0:1789708855.123345:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+18:14341:x1876645426326912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708855.123351:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789708855.123384:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e958e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426326912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708855.123395:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c686752c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867533 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708855.123404:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c686752c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6867533 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708855.123438:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e958e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426327040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708855.123461:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708855.123474:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a141095c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789708855.123485:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426327040 00000100:00100000:3.0:1789708855.123501:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426327040 00000100:00100000:3.0:1789708855.123520:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789708855.123525:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+18:14341:x1876645426327040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708855.123722:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+18:14341:x1876645426327040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708855.123728:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789708855.123756:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e958e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426327040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708855.123787:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e958e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426327168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708855.123820:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708855.123839:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a141095c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789708855.123850:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426327168 00000100:00100000:3.0:1789708855.123853:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426327168 00000100:00100000:3.0:1789708855.123873:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789708855.123879:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+18:14341:x1876645426327168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708855.124002:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+18:14341:x1876645426327168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708855.124008:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789708855.124042:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e958e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426327168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789708855.132345:0:16537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789708855.141056:0:14341:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789708855.141113:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789708855.141126:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c686752c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867533 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708855.141141:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a143fa38000/0xa8f741d1c686752c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867533 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789708855.141165:0:14341:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789708855.141167:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1306dcb000 from 10 10000000:01000000:2.0:1789708855.141170:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789708855.141208:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1403b6ac00/0xa8f741d1c686753a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708855.141216:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1403b6ac00/0xa8f741d1c686753a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708855.141228:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1403b6ac00/0xa8f741d1c686753a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708855.141257:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427031c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426327296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789708855.141337:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708855.141381:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1308543900 going to sleep for 11 seconds 00000100:00100000:1.0:1789708855.142063:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426327296 00000100:00100000:1.0:1789708855.142073:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426327296 00000100:00100000:1.0:1789708855.142121:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789708855.142131:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+18:14341:x1876645426327296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789708855.142147:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708855.142160:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1414ed9800/0xa8f741d1c6867541 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa8f741d1c686753a expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708855.142183:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1414ed9800/0xa8f741d1c6867541 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa8f741d1c686753a expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708855.142194:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1414ed9800/0xa8f741d1c6867541 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa8f741d1c686753a expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708855.142202:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1414ed9800, rc 0) 00000100:00100000:1.0:1789708855.142251:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:14341:x1876645426327296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708855.142258:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789708855.146113:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427031c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426327296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789708855.146141:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1403b6ac00/0xa8f741d1c686753a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867541 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708855.146154:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1403b6ac00/0xa8f741d1c686753a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa8f741d1c6867541 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708855.146239:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e958e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426327424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708855.146293:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708855.146323:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a141095c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789708855.146346:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426327424 00000100:00100000:3.0:1789708855.146352:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426327424 00000100:00100000:3.0:1789708855.146395:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789708855.146405:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:14341:x1876645426327424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708855.146690:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:14341:x1876645426327424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708855.146708:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789708855.146761:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e958e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426327424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789708855.146795:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143e958e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426327552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789708855.146836:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708855.146857:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a141095c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789708855.147175:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426327552 00000100:00100000:1.0:1789708855.147181:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426327552 00000100:00100000:1.0:1789708855.147213:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789708855.147219:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:14341:x1876645426327552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789708855.147384:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:14341:x1876645426327552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708855.147391:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789708855.148166:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143e958e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cdca603d-b230-4a0c-9898-90b77d1d9d18:14341:1876645426327552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789708855.152328:0:16538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789708855.152727:0:14341:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789708855.152763:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789708855.152775:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1403b6ac00/0xa8f741d1c686753a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867541 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708855.152800:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1403b6ac00/0xa8f741d1c686753a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa8f741d1c6867541 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708855.163759:0:15969:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708855.549531:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434b94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426327680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789708855.549607:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708855.549700:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426327680 00000100:00100000:1.0:1789708855.549708:0:15034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426327680 00000100:00100000:1.0:1789708855.549756:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789708855.549764:0:15034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426327680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789708855.549798:0:15034:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789708855.549835:0:15034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426327680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708855.549842:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789708855.549887:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434b94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426327680:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789708855.549912:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708856.056787:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708856.056831:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708856.056872:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708856.056903:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708856.056931:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708856.056947:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415859712 00000100:00100000:0.0:1789708856.056955:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708856.056958:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415859712 00000100:00100000:0.0:1789708856.056985:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708856.057002:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415859456 00000100:00100000:0.0:1789708856.057007:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415859456 00000100:00100000:0.0:1789708856.057036:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415859968 00000100:00100000:0.0:1789708856.057040:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415859968 00000100:00100000:3.0:1789708856.057042:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415859328 00000100:00100000:3.0:1789708856.057047:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415859328 00000100:00100000:0.0:1789708856.057059:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415859584 00000100:00100000:0.0:1789708856.057064:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415859584 00000100:00100000:3.0:1789708856.057081:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:0.0:1789708856.057087:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415859840 00000100:00100000:0.0:1789708856.057092:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415859840 00000100:00100000:3.0:1789708856.057095:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:2363:x1876645415859712:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1789708856.057111:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:0.0:1789708856.057120:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+5:2363:x1876645415859456:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708856.057175:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:2363:x1876645415859712:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 84us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708856.057184:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:2.0:1789708856.057207:0:15032:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789708856.057208:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:3.0:1789708856.057218:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:2363:x1876645415859328:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708856.057220:0:15032:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789708856.057242:0:15031:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789708856.057305:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415859200 00000100:00100000:1.0:1789708856.057310:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415859200 00000100:00100000:1.0:1789708856.057339:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 121 00000100:00100000:1.0:1789708856.057347:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:2363:x1876645415859200:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708856.057391:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:2.0:1789708856.057406:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+5:2363:x1876645415859968:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708856.062749:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+5:2363:x1876645415859968:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 5331us (5830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708856.062766:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:2.0:1789708856.062816:0:15031:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789708856.062832:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:2.0:1789708856.062846:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+5:2363:x1876645415859584:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708856.062916:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+5:2363:x1876645415859584:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 76us (5960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708856.062923:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:2.0:1789708856.062936:0:15031:0:(service.c:3474:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789708856.062943:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:2.0:1789708856.062950:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+5:2363:x1876645415859840:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1789708856.062975:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+5:2363:x1876645415859840:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 26us (5991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708856.062982:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00080000:2.0:1789708856.063236:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789708856.063241:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789708856.063244:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708856.065888:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+5:2363:x1876645415859456:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 8753us (9040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708856.065909:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:1.0:1789708856.066672:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:2363:x1876645415859200:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 9298us (9868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708856.066685:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 121 00000100:00100000:3.0:1789708856.072137:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:2363:x1876645415859328:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 14908us (15193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708856.072153:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 25 00010000:00010000:0.0:1789708856.187027:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789708856.699362:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789708857.084914:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708857.085045:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415860096 00000100:00100000:0.0:1789708857.085057:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415860096 00000100:00100000:0.0:1789708857.085139:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:0.0:1789708857.085150:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:14394:x1876645415860096:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789708857.085172:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708857.085195:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8000/0xa8f741d1c6867548 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4ca7 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085279:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c686754f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085295:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c686754f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085310:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c686754f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085326:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c6867556 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085333:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c6867556 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085340:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c6867556 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085731:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c686755d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085741:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c686755d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085748:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c686755d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708857.085783:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789708857.085788:0:14345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789708857.085824:0:14345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c686755d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085836:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c686754f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085843:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c686754f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085848:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c686754f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085855:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a9c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708857.085859:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c686754f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085867:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c686754f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085879:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:0.0:1789708857.085882:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708857.085887:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c686754f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085892:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c686754f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085905:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c6867556 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085921:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c6867556 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085926:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c6867556 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085931:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a8200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708857.085934:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c6867556 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085940:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c6867556 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085949:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a14148f3e00) 00010000:00010000:0.0:1789708857.085951:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708857.085954:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c6867556 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085960:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c6867556 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.085997:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8000/0xa8f741d1c6867548 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ca7 expref: 8 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.086010:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8800/0xa8f741d1c686755d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ca7 expref: 7 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.086018:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a14148f3600) 00010000:00010000:0.0:1789708857.086020:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708857.086029:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14014a8800, rc 0) 00000100:00100000:0.0:1789708857.086112:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+7:14394:x1876645415860096:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 964us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708857.086120:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:0.0:1789708857.090352:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708857.090458:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415860352 00000100:00100000:2.0:1789708857.090479:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415860352 00000100:00100000:2.0:1789708857.090544:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:2.0:1789708857.090554:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+7:14394:x1876645415860352:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708857.090574:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708857.090597:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867564 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4cae expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.090730:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c686756b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.090746:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c686756b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.090757:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c686756b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.090784:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c6867572 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.090791:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c6867572 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.090798:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c6867572 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.091160:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6867579 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.091169:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6867579 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.091176:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6867579 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708857.091186:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789708857.091630:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c686756b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.091639:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c686756b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.091646:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c686756b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.092975:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708857.092981:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c686756b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.093158:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c686756b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.093178:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a14148f3600) 00010000:00010000:2.0:1789708857.093190:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708857.093196:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c686756b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.093202:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c686756b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.093217:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c6867572 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.093223:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c6867572 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.093229:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c6867572 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.093234:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708857.093236:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c6867572 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.093241:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c6867572 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.093247:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a1414c38e00) 00010000:00010000:2.0:1789708857.093249:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708857.093251:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c6867572 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.093265:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c6867572 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.094532:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867564 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cae expref: 10 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.094554:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6ba00/0xa8f741d1c6867579 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cae expref: 9 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.094562:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1414c38400) 00010000:00010000:2.0:1789708857.094564:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708857.094567:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6ba00, rc 0) 00000100:00100000:2.0:1789708857.094729:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+9:14394:x1876645415860352:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 4174us (4386us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789708857.094740:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:1.0:1789708857.103703:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708857.105923:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415860480 00000100:00100000:0.0:1789708857.105955:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415860480 00000100:00100000:0.0:1789708857.106046:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:0.0:1789708857.106057:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+9:14394:x1876645415860480:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789708857.106198:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+9:14394:x1876645415860480:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 Request processed in 142us (2505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708857.106206:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:3.0:1789708857.130537:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708857.130984:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415860608 00000100:00100000:2.0:1789708857.130995:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415860608 00000100:00100000:2.0:1789708857.131057:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:2.0:1789708857.131068:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+9:14400:x1876645415860608:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708857.131089:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708857.131110:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867587 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4cb5 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.131175:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686758e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.131190:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686758e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.131225:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686758e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.131242:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6867595 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.131250:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6867595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.131258:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6867595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.131970:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686758e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.131981:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686758e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.131987:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686758e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.131992:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708857.131996:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686758e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.132002:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686758e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.132014:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:2.0:1789708857.132016:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708857.132020:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686758e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.132031:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686758e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.132043:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6867595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.132048:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6867595 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.132053:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6867595 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.132057:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708857.132060:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6867595 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.132065:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6867595 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.132071:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a1414c38e00) 00010000:00010000:2.0:1789708857.132074:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708857.132076:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6867595 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.132081:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c6867595 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.132112:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867587 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cb5 expref: 10 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.132133:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:2.0:1789708857.132136:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708857.132139:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867587 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cb5 expref: 10 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.132150:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6be00, rc 0) 00000100:00100000:2.0:1789708857.132268:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+9:14400:x1876645415860608:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1201us (1740us total) trans 0 rc 301/301 00000100:00100000:2.0:1789708857.132286:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:3.0:1789708857.136636:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708857.136897:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415860736 00000100:00100000:2.0:1789708857.136909:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415860736 00000100:00100000:2.0:1789708857.136959:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:2.0:1789708857.136968:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+9:14400:x1876645415860736:12345-192.168.202.53@tcp:700:lfs.0 00000100:00100000:2.0:1789708857.137068:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+9:14400:x1876645415860736:12345-192.168.202.53@tcp:700:lfs.0 Request processed in 100us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708857.137077:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:1.0:1789708857.140558:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708857.142811:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415860992 00000100:00100000:0.0:1789708857.142828:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415860992 00000100:00100000:0.0:1789708857.142902:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:0.0:1789708857.142913:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+9:14400:x1876645415860992:12345-192.168.202.53@tcp:36:lfs.0 00010000:00010000:0.0:1789708857.143132:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708857.143160:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68674ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c30 expref: 9 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.143183:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:0.0:1789708857.143188:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708857.143436:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8000/0xa8f741d1c686759c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.143465:0:14345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9400/0xa8f741d1c6867502 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c92 expref: 5 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.143496:0:14345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8000/0xa8f741d1c686759c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.143533:0:14345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9400/0xa8f741d1c6867502 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c92 expref: 5 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.143553:0:14345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9400/0xa8f741d1c6867502 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c92 expref: 5 pid: 14345 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708857.143569:0:14345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14345:1876645426327808:192.168.202.53@tcp:104: 00000100:00100000:0.0:1789708857.145010:0:14345:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405235b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789708857.149757:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708857.150252:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415861120 00000100:00100000:3.0:1789708857.150264:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415861120 00010000:00010000:3.0:1789708857.150317:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9400/0xa8f741d1c6867502 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c92 expref: 6 pid: 14345 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708857.150377:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:3.0:1789708857.150388:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:2362:x1876645415861120:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789708857.150405:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789708857.150412:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9400/0xa8f741d1c6867502 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c92 expref: 6 pid: 14345 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.150426:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9400/0xa8f741d1c6867502 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c92 expref: 6 pid: 14345 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.150465:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:3.0:1789708857.150480:0:14329:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8000/0xa8f741d1c686759c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.150490:0:14329:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8000/0xa8f741d1c686759c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.150497:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8000/0xa8f741d1c686759c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.150517:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789708857.150565:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:2362:x1876645415861120:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 179us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708857.150573:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00010000:00010000:2.0:1789708857.150924:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9400/0xa8f741d1c6867502 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4c92 expref: 5 pid: 14345 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708857.150944:0:14345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14345:1876645426327808:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708857.150964:0:14345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8000/0xa8f741d1c686759c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.150973:0:14345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8000/0xa8f741d1c686759c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.150990:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8000/0xa8f741d1c686759c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.151016:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68675a3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.151026:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68675a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.151035:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68675a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708857.152594:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789708857.152610:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8000/0xa8f741d1c686759c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.152619:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8000/0xa8f741d1c686759c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.152627:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8000/0xa8f741d1c686759c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.152634:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a8000 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708857.152638:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8000/0xa8f741d1c686759c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.152647:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8000/0xa8f741d1c686759c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.152688:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1414c38800) 00010000:00010000:2.0:1789708857.152691:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708857.152703:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8000/0xa8f741d1c686759c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.152709:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8000/0xa8f741d1c686759c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789708857.152730:0:14345:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000711bb93 reply state 000000007c9b932f transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68675a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708857.152738:0:14345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789708857.152821:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+10:14400:x1876645415860992:12345-192.168.202.53@tcp:36:lfs.0 Request processed in 9907us (12735us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789708857.152830:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00010000:00010000:0.0:1789708857.155707:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68675a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.155726:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68675a3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.155734:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68675a3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.155740:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6be00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708857.155745:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68675a3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.155754:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68675a3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.155771:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a1414c38e00) 00010000:00010000:0.0:1789708857.155787:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708857.155792:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68675a3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.155799:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68675a3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.210827:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789708857.230559:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708857.230689:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415861248 00000100:00100000:0.0:1789708857.230697:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415861248 00000100:00100000:0.0:1789708857.230747:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:0.0:1789708857.230754:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+9:14408:x1876645415861248:12345-192.168.202.53@tcp:101:lctl.0 00010000:00010000:0.0:1789708857.230775:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708857.230794:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c68675aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4cbc expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.230846:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68675b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.230855:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68675b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.230863:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68675b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708857.230890:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789708857.230893:0:14346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789708857.230943:0:14346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68675b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.230969:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c68675aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cbc expref: 11 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.230993:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9c00/0xa8f741d1c68675b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cbc expref: 10 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.231002:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14148f3e00) 00010000:00010000:0.0:1789708857.231004:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708857.231007:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14014a9c00, rc 0) 00000100:00100000:0.0:1789708857.231049:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+10:14408:x1876645415861248:12345-192.168.202.53@tcp:101:lctl.0 Request processed in 296us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708857.231054:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:3.0:1789708857.245393:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708857.245549:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415861376 00000100:00100000:1.0:1789708857.245558:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415861376 00000100:00100000:1.0:1789708857.245646:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:1.0:1789708857.245682:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a2dd95b-f0e7-4239-8480-4d058ec34c66+5:14409:x1876645415861376:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1789708857.245700:0:15054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708857.245721:0:15054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed9200/0xa8f741d1c68675b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4cc3 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.245776:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8600/0xa8f741d1c68675bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.245788:0:15054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8600/0xa8f741d1c68675bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.245797:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8600/0xa8f741d1c68675bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708857.245828:0:15054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789708857.245831:0:15054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789708857.245845:0:15054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8600/0xa8f741d1c68675bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.245863:0:15054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed9200/0xa8f741d1c68675b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cc3 expref: 7 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.245877:0:15054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8600/0xa8f741d1c68675bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cc3 expref: 6 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.245900:0:15054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14148f3e00) 00010000:00010000:1.0:1789708857.245902:0:15054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789708857.245904:0:15054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1414ed8600, rc 0) 00000100:00100000:1.0:1789708857.245973:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:14409:x1876645415861376:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 292us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708857.245980:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:3.0:1789708857.248276:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708857.251579:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415861504 00000100:00100000:2.0:1789708857.251594:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415861504 00000100:00100000:2.0:1789708857.251686:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:2.0:1789708857.251695:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:14409:x1876645415861504:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708857.251720:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708857.251739:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68675c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4cca expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.251792:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68675cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.251803:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68675cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.251811:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68675cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.251822:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68675d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.251839:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68675d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.251843:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68675d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.251954:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68675db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.251962:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68675db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.251967:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68675db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708857.251997:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789708857.252001:0:14346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789708857.252017:0:14346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68675db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.252029:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68675cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.252036:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68675cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.252042:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68675cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.252048:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708857.252052:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68675cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.252067:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68675cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.252079:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14148f3e00) 00010000:00010000:2.0:1789708857.252082:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708857.252086:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68675cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.252093:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68675cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.252106:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68675d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.252113:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68675d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.252119:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68675d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.252124:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6aa00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708857.252127:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68675d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.252133:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68675d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.252140:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a1414c38800) 00010000:00010000:2.0:1789708857.252142:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708857.252144:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68675d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.252160:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68675d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.252192:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68675c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cca expref: 8 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.252216:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68675db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cca expref: 7 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.252221:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1414c38000) 00010000:00010000:2.0:1789708857.252223:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789708857.252225:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6be00, rc 0) 00000100:00100000:2.0:1789708857.252285:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a2dd95b-f0e7-4239-8480-4d058ec34c66+7:14409:x1876645415861504:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 592us (4021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708857.252290:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:3.0:1789708857.259094:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708857.259440:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415861760 00000100:00100000:2.0:1789708857.259451:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415861760 00000100:00100000:2.0:1789708857.259515:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:2.0:1789708857.259525:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+7:14409:x1876645415861760:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708857.259543:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708857.259562:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68675e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4cd1 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708857.259642:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789708857.259771:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68675e2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cd1 expref: 9 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.259798:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14148f3e00) 00010000:00010000:2.0:1789708857.259800:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789708857.259804:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68675e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cd1 expref: 9 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.259813:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6b200, rc 0) 00000100:00100000:2.0:1789708857.259859:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+8:14409:x1876645415861760:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 337us (783us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789708857.259864:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:2.0:1789708857.262800:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708857.263085:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415862016 00000100:00100000:0.0:1789708857.263096:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415862016 00000100:00100000:0.0:1789708857.263160:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:0.0:1789708857.263170:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a2dd95b-f0e7-4239-8480-4d058ec34c66+8:14409:x1876645415862016:12345-192.168.202.53@tcp:36:lfs.0 00010000:00010000:0.0:1789708857.263230:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708857.263254:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c68675db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cca expref: 8 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.263268:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1414c38000) 00010000:00010000:0.0:1789708857.263277:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789708857.263297:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c68675f0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.263306:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c68675f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.263312:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c68675f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789708857.263525:0:14346:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000948b710b reply state 00000000077306e2 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c68675f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708857.263532:0:14346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789708857.263539:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789708857.263614:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a2dd95b-f0e7-4239-8480-4d058ec34c66+9:14409:x1876645415862016:12345-192.168.202.53@tcp:36:lfs.0 Request processed in 446us (822us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789708857.263619:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 24 00010000:00010000:1.0:1789708857.265212:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c68675f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.265228:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c68675f0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.265236:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c68675f0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.265242:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a8200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708857.265247:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c68675f0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.265255:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c68675f0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.265269:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a14148f3a00) 00010000:00010000:1.0:1789708857.265273:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789708857.265277:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c68675f0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.265282:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8200/0xa8f741d1c68675f0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708857.270094:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708857.270456:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415862272 00000100:00100000:1.0:1789708857.270476:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415862272 00000100:00100000:1.0:1789708857.270532:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:1.0:1789708857.270541:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+8:14409:x1876645415862272:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:1.0:1789708857.270780:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+9:14409:x1876645415862272:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 239us (698us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789708857.270789:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:3.0:1789708857.274424:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708857.274527:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415862528 00000100:00100000:2.0:1789708857.274537:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415862528 00000100:00100000:2.0:1789708857.274602:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:2.0:1789708857.274614:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+9:14409:x1876645415862528:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708857.274639:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708857.274705:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68675f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4cd8 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.274786:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68675fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.274797:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68675fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.274805:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68675fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.274825:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867605 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.274830:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867605 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.274834:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867605 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708857.274926:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789708857.275031:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68675fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.275039:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68675fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.275045:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68675fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.275050:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708857.275053:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68675fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.275058:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68675fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.275067:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14148f3e00) 00010000:00010000:2.0:1789708857.275069:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708857.275072:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68675fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.275083:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68675fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.275097:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867605 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.275103:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867605 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.275109:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867605 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.275114:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6aa00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708857.275118:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867605 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.275123:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867605 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.275130:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a1414c38800) 00010000:00010000:2.0:1789708857.275133:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708857.275136:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867605 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.275142:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867605 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.275173:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68675f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cd8 expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.275189:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14148f3e00) 00010000:00010000:2.0:1789708857.275190:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789708857.275193:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68675f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cd8 expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.275293:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6b200, rc 0) 00000100:00100000:2.0:1789708857.275348:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+10:14409:x1876645415862528:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 736us (936us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789708857.275357:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:3.0:1789708857.277491:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708857.279516:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415862656 00000100:00100000:0.0:1789708857.279533:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415862656 00000100:00100000:0.0:1789708857.279607:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 26 00000100:00100000:0.0:1789708857.279618:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a2dd95b-f0e7-4239-8480-4d058ec34c66+10:14409:x1876645415862656:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1789708857.279641:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708857.279703:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6867613 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4cdf expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.279793:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686761a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.279805:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686761a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.279814:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686761a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789708857.279834:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789708857.279837:0:14346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789708857.279850:0:14346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686761a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.279885:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6867613 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cdf expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.279899:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686761a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cdf expref: 11 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.279905:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a14148f3800) 00010000:00010000:0.0:1789708857.279907:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789708857.279909:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14014a9200, rc 0) 00000100:00100000:0.0:1789708857.279981:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a2dd95b-f0e7-4239-8480-4d058ec34c66+11:14409:x1876645415862656:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 365us (2500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708857.279989:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 26 00000100:00100000:3.0:1789708857.283273:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708857.283363:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415862784 00000100:00100000:1.0:1789708857.283375:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415862784 00000100:00100000:1.0:1789708857.283437:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:1.0:1789708857.283447:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+11:14409:x1876645415862784:12345-192.168.202.53@tcp:37:lfs.0 00000100:00100000:0.0:1789708857.288310:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+11:14409:x1876645415862784:12345-192.168.202.53@tcp:37:lfs.0 Request processed in 4852us (5037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708857.288330:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:1.0:1789708857.292761:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708857.292822:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415863040 00000100:00100000:2.0:1789708857.292832:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415863040 00000100:00100000:2.0:1789708857.292877:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:2.0:1789708857.292886:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14051ee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a2dd95b-f0e7-4239-8480-4d058ec34c66+11:14409:x1876645415863040:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1789708857.293117:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14051ee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a2dd95b-f0e7-4239-8480-4d058ec34c66+12:14409:x1876645415863040:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 230us (366us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789708857.293126:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:3.0:1789708857.331013:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708857.331331:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415863168 00000100:00100000:1.0:1789708857.331342:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415863168 00000100:00100000:1.0:1789708857.331399:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:1.0:1789708857.331406:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+10:14415:x1876645415863168:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:1.0:1789708857.331424:0:15054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708857.331442:0:15054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed9000/0xa8f741d1c6867621 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4ce6 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331537:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867628 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331554:0:15054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867628 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331580:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867628 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331592:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686762f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331597:0:15054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686762f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331601:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686762f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331726:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed9a00/0xa8f741d1c6867636 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331734:0:15054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed9a00/0xa8f741d1c6867636 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331741:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed9a00/0xa8f741d1c6867636 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708857.331767:0:15054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789708857.331771:0:15054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789708857.331805:0:15054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed9a00/0xa8f741d1c6867636 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331815:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867628 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331820:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867628 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331832:0:15054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867628 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331836:0:15054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed8800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708857.331839:0:15054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867628 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331843:0:15054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867628 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331852:0:15054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14148f3e00) 00010000:00010000:1.0:1789708857.331854:0:15054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708857.331858:0:15054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867628 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331862:0:15054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867628 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331871:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686762f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331874:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686762f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331878:0:15054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686762f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331881:0:15054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed8200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708857.331883:0:15054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686762f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331891:0:15054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686762f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331896:0:15054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a1407c32900) 00010000:00010000:1.0:1789708857.331897:0:15054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708857.331899:0:15054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686762f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331902:0:15054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686762f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331925:0:15054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed9000/0xa8f741d1c6867621 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ce6 expref: 12 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331937:0:15054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed9a00/0xa8f741d1c6867636 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ce6 expref: 11 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.331944:0:15054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a14148f3800) 00010000:00010000:1.0:1789708857.331946:0:15054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789708857.331948:0:15054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1414ed9a00, rc 0) 00000100:00100000:1.0:1789708857.332025:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+11:14415:x1876645415863168:12345-192.168.202.53@tcp:101:bash.0 Request processed in 617us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708857.332032:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:3.0:1789708857.336028:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708857.336158:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415863424 00000100:00100000:0.0:1789708857.336170:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415863424 00000100:00100000:0.0:1789708857.336247:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:0.0:1789708857.336255:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+11:14415:x1876645415863424:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1789708857.336274:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708857.336291:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c686763d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4ced expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.336392:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6867644 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.336406:0:14344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686761a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cdf expref: 11 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.336427:0:14344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6867644 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.336476:0:14344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686761a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cdf expref: 11 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.336490:0:14344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686761a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cdf expref: 11 pid: 14346 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708857.336504:0:14344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082be300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14344:1876645426327936:192.168.202.53@tcp:104: 00000100:00100000:0.0:1789708857.336588:0:14344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405235240 going to sleep for 11 seconds 00000100:00100000:0.0:1789708857.339722:0:14344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082be300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14344:1876645426327936:192.168.202.53@tcp:104: 00010000:00010000:0.0:1789708857.339753:0:14344:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6867644 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708857.340295:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708857.340520:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415863552 00000100:00100000:2.0:1789708857.340528:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415863552 00010000:00010000:2.0:1789708857.340564:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686761a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cdf expref: 12 pid: 14346 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708857.340599:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:2.0:1789708857.340608:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e959f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+12:2362:x1876645415863552:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708857.340626:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708857.340646:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686761a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cdf expref: 12 pid: 14346 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.340735:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686761a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cdf expref: 12 pid: 14346 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.340760:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c686761a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cdf expref: 12 pid: 14346 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.340774:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a14148f3800) 00010000:00010000:2.0:1789708857.340777:0:14330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6867644 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.340784:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6867644 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.340791:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6867644 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.340812:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789708857.340841:0:14344:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6867644 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.340848:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6867644 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.340876:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c686764b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.340886:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c686764b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.340895:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c686764b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708857.340911:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e959f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a2dd95b-f0e7-4239-8480-4d058ec34c66+11:2362:x1876645415863552:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 304us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708857.340919:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00010000:00010000:3.0:1789708857.341925:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6867652 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.342217:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6867652 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.342227:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6867652 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708857.342240:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789708857.342269:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6867644 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.342288:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6867644 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.342295:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6867644 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.342300:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a8400 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708857.342304:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6867644 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.342312:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6867644 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.342324:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a14148f3800) 00010000:00010000:3.0:1789708857.342327:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789708857.342332:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6867644 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.342338:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8400/0xa8f741d1c6867644 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789708857.342352:0:14344:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef10f4fb reply state 000000002668477e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c686764b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708857.342360:0:14344:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789708857.342396:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c686763d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ced expref: 14 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.342410:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6867652 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ced expref: 13 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.342428:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:3.0:1789708857.342430:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789708857.342432:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4600, rc 0) 00000100:00100000:3.0:1789708857.342549:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+14:14415:x1876645415863424:12345-192.168.202.53@tcp:101:bash.0 Request processed in 6292us (6614us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789708857.342558:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 28 00010000:00010000:0.0:1789708857.348544:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c686764b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.348567:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c686764b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.348575:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c686764b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.348581:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5c00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708857.348586:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c686764b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.348612:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c686764b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.348629:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a1411b4a000) 00010000:00010000:0.0:1789708857.348632:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789708857.348637:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c686764b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.348643:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5c00/0xa8f741d1c686764b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708857.356926:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708857.357413:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415863680 00000100:00100000:1.0:1789708857.357424:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415863680 00000100:00100000:1.0:1789708857.357546:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:1.0:1789708857.357558:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+13:14415:x1876645415863680:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:1.0:1789708857.357600:0:15054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708857.357623:0:15054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c6867660 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4cf4 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.357735:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867667 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.357750:0:15054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867667 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.357761:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867667 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708857.357800:0:15054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789708857.357805:0:15054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789708857.357822:0:15054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867667 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.357832:0:15054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867667 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.357858:0:15054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c6867660 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cf4 expref: 15 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.357876:0:15054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867667 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cf4 expref: 14 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.357885:0:15054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:1.0:1789708857.357889:0:15054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708857.357893:0:15054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1414ed8800, rc 0) 00000100:00100000:1.0:1789708857.357973:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+14:14415:x1876645415863680:12345-192.168.202.53@tcp:101:bash.0 Request processed in 417us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708857.357981:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:3.0:1789708857.359981:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708857.360319:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415863936 00000100:00100000:2.0:1789708857.360328:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415863936 00000100:00100000:2.0:1789708857.360374:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:2.0:1789708857.360381:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+14:14415:x1876645415863936:12345-192.168.202.53@tcp:35:bash.0 00000100:00100000:2.0:1789708857.360704:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+15:14415:x1876645415863936:12345-192.168.202.53@tcp:35:bash.0 Request processed in 321us (730us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789708857.360730:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:3.0:1789708857.449408:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708857.449563:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415864192 00000100:00100000:1.0:1789708857.449574:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415864192 00000100:00100000:1.0:1789708857.449630:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:1.0:1789708857.449642:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+15:14425:x1876645415864192:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1789708857.449686:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708857.449763:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686766e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4cfb expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708857.449858:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789708857.449995:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686766e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cfb expref: 17 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.450014:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a14148f3e00) 00010000:00010000:1.0:1789708857.450017:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789708857.450022:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686766e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cfb expref: 17 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.450037:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1414ed8200, rc 0) 00000100:00100000:1.0:1789708857.450187:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+16:14425:x1876645415864192:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 546us (785us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1789708857.450292:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:3.0:1789708857.452264:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708857.452394:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415864448 00000100:00100000:2.0:1789708857.452404:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415864448 00000100:00100000:2.0:1789708857.452569:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:2.0:1789708857.452581:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e95ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+16:14425:x1876645415864448:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1789708857.452899:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e95ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+17:14425:x1876645415864448:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 319us (641us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789708857.452908:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:3.0:1789708857.478868:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708857.478970:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415864704 00000100:00100000:2.0:1789708857.478979:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415864704 00000100:00100000:2.0:1789708857.479036:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:2.0:1789708857.479047:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+17:14428:x1876645415864704:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1789708857.479073:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708857.479097:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c686767c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4d02 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.479209:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867683 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.479224:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867683 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.479235:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867683 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708857.479247:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789708857.479370:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c686767c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d02 expref: 20 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.479398:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867683 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d02 expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.479405:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:2.0:1789708857.479407:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708857.479410:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6aa00, rc 0) 00000100:00100000:2.0:1789708857.479484:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+19:14428:x1876645415864704:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 439us (627us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789708857.479492:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:3.0:1789708857.481758:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708857.482046:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415864832 00000100:00100000:0.0:1789708857.482056:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415864832 00000100:00100000:0.0:1789708857.482114:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:0.0:1789708857.482126:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+19:14428:x1876645415864832:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:0.0:1789708857.482197:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6867691 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.482212:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6867691 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.482223:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6867691 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.482249:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6867691 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.482255:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6867691 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.482277:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6867691 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.482283:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a8e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:0.0:1789708857.482287:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6867691 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.482295:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6867691 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.482306:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:0.0:1789708857.482309:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789708857.482313:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6867691 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.482319:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a8e00/0xa8f741d1c6867691 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708857.482623:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+19:14428:x1876645415864832:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 498us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708857.482632:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:2.0:1789708857.483549:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708857.483823:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415864960 00000100:00100000:0.0:1789708857.483833:0:14331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415864960 00000100:00100000:0.0:1789708857.483886:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:0.0:1789708857.483896:0:14331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427031f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+19:2364:x1876645415864960:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708857.483910:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708857.483947:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867683 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d02 expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.483978:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:0.0:1789708857.483983:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708857.484021:0:14331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427031f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+18:2364:x1876645415864960:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 128us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708857.484028:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:3.0:1789708857.485069:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708857.485233:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415865216 00000100:00100000:0.0:1789708857.485241:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415865216 00000100:00100000:0.0:1789708857.485271:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:0.0:1789708857.485277:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+18:14428:x1876645415865216:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:0.0:1789708857.485633:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+19:14428:x1876645415865216:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 355us (569us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789708857.485639:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000040:00080000:1.0:1789708857.724377:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789708857.744313:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708857.744844:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415865472 00000100:00100000:1.0:1789708857.744857:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415865472 00000100:00100000:1.0:1789708857.744947:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:1.0:1789708857.744978:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+19:14459:x1876645415865472:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:1.0:1789708857.745012:0:15054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708857.745035:0:15054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c6867698 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4d09 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.745163:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed9c00/0xa8f741d1c686769f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.745179:0:15054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed9c00/0xa8f741d1c686769f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.745193:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed9c00/0xa8f741d1c686769f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708857.745204:0:15054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789708857.745367:0:15054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c6867698 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d09 expref: 22 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.745388:0:15054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed9c00/0xa8f741d1c686769f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d09 expref: 21 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.745396:0:15054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:1.0:1789708857.745400:0:15054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789708857.745403:0:15054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1414ed9c00, rc 0) 00000100:00100000:1.0:1789708857.745486:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+21:14459:x1876645415865472:12345-192.168.202.53@tcp:101:cat.0 Request processed in 511us (1185us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789708857.745494:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:3.0:1789708857.751325:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708857.751369:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708857.751509:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415865856 00000100:00100000:2.0:1789708857.751521:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415865856 00000100:00100000:2.0:1789708857.751590:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:2.0:1789708857.751600:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f271c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+21:2361:x1876645415865856:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708857.751618:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708857.751645:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed9c00/0xa8f741d1c686769f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d09 expref: 21 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.751704:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:2.0:1789708857.751711:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708857.751774:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f271c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+20:2361:x1876645415865856:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 174us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708857.751782:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:1.0:1789708857.751859:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415865728 00000100:00100000:1.0:1789708857.751864:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415865728 00000100:00100000:1.0:1789708857.751935:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:1.0:1789708857.751944:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+20:14459:x1876645415865728:12345-192.168.202.53@tcp:35:cat.0 00000100:00100000:1.0:1789708857.752263:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+21:14459:x1876645415865728:12345-192.168.202.53@tcp:35:cat.0 Request processed in 320us (948us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1789708857.752271:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:0.0:1789708857.821156:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708857.822297:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415866112 00000100:00100000:1.0:1789708857.822309:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415866112 00000100:00100000:1.0:1789708857.822370:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:1.0:1789708857.822391:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+21:14465:x1876645415866112:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:1.0:1789708857.822414:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708857.822433:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c68676ad lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4d10 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.822538:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8000/0xa8f741d1c68676b4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.822553:0:14346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6867652 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ced expref: 22 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.822560:0:14346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867667 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cf4 expref: 22 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.822568:0:14346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8000/0xa8f741d1c68676b4 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.822604:0:14346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867667 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cf4 expref: 22 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.822639:0:14346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867667 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cf4 expref: 22 pid: 15054 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708857.822683:0:14346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434b96300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14346:1876645426328064:192.168.202.53@tcp:104: 00010000:00010000:1.0:1789708857.822793:0:14346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6867652 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ced expref: 22 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.822804:0:14346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6867652 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ced expref: 22 pid: 14344 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708857.822813:0:14346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434b97800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14346:1876645426328192:192.168.202.53@tcp:104: 00000100:00100000:1.0:1789708857.822841:0:14346:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a142d9d3000 going to sleep for 11 seconds 00000100:00100000:3.0:1789708857.828238:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708857.828286:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708857.828326:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415866240 00000100:00100000:0.0:1789708857.828336:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415866240 00010000:00010000:0.0:1789708857.828381:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867667 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cf4 expref: 23 pid: 15054 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708857.828434:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415866368 00000100:00100000:0.0:1789708857.828438:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415866368 00010000:00010000:0.0:1789708857.828452:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6867652 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ced expref: 24 pid: 14344 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708857.828477:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:0.0:1789708857.828487:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1a7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+24:2361:x1876645415866240:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708857.828519:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708857.828526:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867667 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cf4 expref: 24 pid: 15054 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.828539:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867667 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cf4 expref: 24 pid: 15054 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.828566:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:0.0:1789708857.828572:0:14329:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8000/0xa8f741d1c68676b4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.828580:0:14329:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8000/0xa8f741d1c68676b4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.828586:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708857.828642:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1a7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+24:2361:x1876645415866240:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 154us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708857.828681:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:0.0:1789708857.828737:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:0.0:1789708857.828744:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f270e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+23:2361:x1876645415866368:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708857.828753:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708857.828759:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6867652 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ced expref: 23 pid: 14344 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.828769:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6867652 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ced expref: 23 pid: 14344 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.828793:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:0.0:1789708857.828797:0:14329:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8000/0xa8f741d1c68676b4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.828804:0:14329:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8000/0xa8f741d1c68676b4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.828812:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8000/0xa8f741d1c68676b4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.828832:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708857.828853:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f270e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+23:2361:x1876645415866368:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 109us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708857.828860:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00010000:00010000:1.0:1789708857.834428:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867667 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4cf4 expref: 22 pid: 15054 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708857.834458:0:14346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434b96300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14346:1876645426328064:192.168.202.53@tcp:104: 00010000:00010000:1.0:1789708857.834484:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4600/0xa8f741d1c6867652 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4ced expref: 21 pid: 14344 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708857.834497:0:14346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434b97800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14346:1876645426328192:192.168.202.53@tcp:104: 00010000:00010000:1.0:1789708857.834530:0:14346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8000/0xa8f741d1c68676b4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.834541:0:14346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8000/0xa8f741d1c68676b4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.834566:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8000/0xa8f741d1c68676b4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708857.834591:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789708857.834817:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c68676ad lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d10 expref: 22 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.834834:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8000/0xa8f741d1c68676b4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d10 expref: 21 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.834843:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:1.0:1789708857.834846:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789708857.834850:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1414ed8000, rc 0) 00000100:00100000:1.0:1789708857.834938:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+21:14465:x1876645415866112:12345-192.168.202.53@tcp:101:dd.0 Request processed in 12549us (13780us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1789708857.834947:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:3.0:1789708857.837402:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708857.837619:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415866624 00000100:00100000:2.0:1789708857.837630:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415866624 00000100:00100000:2.0:1789708857.837740:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00100000:2.0:1789708857.837751:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+21:14465:x1876645415866624:12345-192.168.202.53@tcp:36:dd.0 00010000:00010000:2.0:1789708857.838090:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.838109:0:15054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.838120:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789708857.838192:0:15054:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789708857.838232:0:15054:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000267a9d5b reply state 000000006d1eb758 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708857.838241:0:15054:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789708857.838353:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+24:14465:x1876645415866624:12345-192.168.202.53@tcp:36:dd.0 Request processed in 602us (961us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789708857.838361:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 35 00000020:00080000:2.0:1789708857.838366:0:15054:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789708857.841033:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.841051:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.841059:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.841066:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708857.841070:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.841099:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676c2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.841117:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:1.0:1789708857.841120:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708857.841126:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676c2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708857.841134:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676c2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708857.841198:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708857.841325:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415866752 00000100:00100000:0.0:1789708857.841338:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415866752 00000100:00100000:0.0:1789708857.841408:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:0.0:1789708857.841418:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+23:14465:x1876645415866752:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:0.0:1789708857.841441:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789708857.841467:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c68676c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4d17 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.841526:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c68676c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d17 expref: 24 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.841540:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c68676c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d17 expref: 24 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.841574:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:0.0:1789708857.841577:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789708857.841580:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a14014a9200, rc 0) 00000100:00100000:0.0:1789708857.841687:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+24:14465:x1876645415866752:12345-192.168.202.53@tcp:101:dd.0 Request processed in 270us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708857.841695:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:3.0:1789708857.853081:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708857.853171:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415867008 00000100:00100000:0.0:1789708857.853182:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415867008 00000100:00100000:0.0:1789708857.853256:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:0.0:1789708857.853267:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f271880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+24:14465:x1876645415867008:12345-192.168.202.53@tcp:103:dd.0 00010000:00010000:0.0:1789708857.853286:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708857.853315:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a14014a9200/0xa8f741d1c68676c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d17 expref: 24 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708857.853339:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:0.0:1789708857.853344:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708857.853560:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f271880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+23:14465:x1876645415867008:12345-192.168.202.53@tcp:103:dd.0 Request processed in 293us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708857.853569:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:3.0:1789708857.860994:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708857.862233:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415867136 00000100:00100000:2.0:1789708857.862248:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415867136 00000100:00100000:2.0:1789708857.862325:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:2.0:1789708857.862337:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+23:14465:x1876645415867136:12345-192.168.202.53@tcp:58:dd.0 00010000:00010000:2.0:1789708857.862472:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68676d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.862488:0:15054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68676d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708857.862500:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68676d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789708857.863760:0:15054:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789708857.863921:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789708857.865284:0:15054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789708857.865544:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+23:14465:x1876645415867136:12345-192.168.202.53@tcp:58:dd.0 Request processed in 3203us (4555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708857.865558:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:0.0:1789708857.868367:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708857.868534:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415867264 00000100:00100000:3.0:1789708857.868546:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415867264 00000100:00100000:3.0:1789708857.868610:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 38 00000100:00100000:3.0:1789708857.868621:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+23:14465:x1876645415867264:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:3.0:1789708857.868699:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708857.868723:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c68676d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4d1e expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.868781:0:14344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68676d0 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.868792:0:14344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c68676d7 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d1e expref: 24 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.868811:0:14344:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68676d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.868825:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c68676d7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d1e expref: 24 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.868838:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:3.0:1789708857.868842:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789708857.868845:0:14344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c68676d7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d1e expref: 24 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708857.868853:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5600, rc 0) 00000100:00100000:3.0:1789708857.868907:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+24:14465:x1876645415867264:12345-192.168.202.53@tcp:101:dd.0 Request processed in 289us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708857.868914:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 38 00000100:00100000:2.0:1789708858.111939:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426328576:0@lo:400:kworker.0 00000100:00100000:2.0:1789708858.112017:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708858.112069:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13082bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426329088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789708858.112095:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708858.112123:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789708858.112129:0:3288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426328704:0@lo:400:kworker.0 00000100:00100000:2.0:1789708858.112156:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708858.112192:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426328576 00000100:00100000:2.0:1789708858.112200:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426328576 00000100:00100000:2.0:1789708858.112260:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789708858.112271:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426328576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708858.113113:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426328576:12345-0@lo:400:kworker.0 Request processed in 839us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708858.113123:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789708858.113152:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789708858.113275:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426328576:0@lo:400:kworker.0 00000100:00100000:2.0:1789708858.113363:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426328448:0@lo:400:kworker.0 00000100:00100000:2.0:1789708858.113402:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708858.113427:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876645426328960:0@lo:400:kworker.0 00000100:00100000:2.0:1789708858.113472:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708858.113495:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789708858.113501:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdca603d-b230-4a0c-9898-90b77d1d9d18:3287:1876645426328320:0@lo:400:kworker.0 00000100:00100000:2.0:1789708858.113528:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708858.113555:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1427031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426328832:0@lo:400:kworker.0 00000100:00100000:2.0:1789708858.113577:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789708858.113607:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426328320 00000100:00100000:2.0:1789708858.113613:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426328320 00000100:00100000:2.0:1789708858.113676:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789708858.113678:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426328704 00000100:00100000:0.0:1789708858.113685:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426328704 00000100:00100000:2.0:1789708858.113688:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:3287:x1876645426328320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708858.113719:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426328960 00000100:00100000:0.0:1789708858.113724:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426328960 00000100:00100000:2.0:1789708858.113736:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdca603d-b230-4a0c-9898-90b77d1d9d18+19:3287:x1876645426328320:12345-0@lo:400:kworker.0 Request processed in 50us (205us total) trans 0 rc 0/0 00000100:00080000:0.0:1789708858.113742:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789708858.113746:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789708858.113764:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426328832 00000100:00100000:0.0:1789708858.113776:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426328832 00000100:00100000:2.0:1789708858.113782:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789708858.113793:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426328704:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789708858.113793:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708858.113821:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789708858.113831:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876645426328960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708858.113840:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1876645426328704:12345-0@lo:400:kworker.0 Request processed in 48us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708858.113847:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789708858.113864:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789708858.113873:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426328832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789708858.113880:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876645426328960:12345-0@lo:400:kworker.0 Request processed in 50us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708858.113889:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789708858.113911:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876645426328832:12345-0@lo:400:kworker.0 Request processed in 40us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708858.113919:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789708858.113945:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426329088 00000100:00100000:0.0:1789708858.113950:0:15034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426329088 00000100:00100000:2.0:1789708858.113974:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427031f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1876645426328704:0@lo:400:kworker.0 00000100:00100000:2.0:1789708858.114010:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdca603d-b230-4a0c-9898-90b77d1d9d18:3287:1876645426328320:0@lo:400:kworker.0 00000100:00100000:2.0:1789708858.114033:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1876645426328832:0@lo:400:kworker.0 00000100:00100000:2.0:1789708858.114046:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1876645426328960:0@lo:400:kworker.0 00000100:00100000:2.0:1789708858.114077:0:16575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426328448 00000100:00100000:2.0:1789708858.114080:0:16575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426328448 00000100:00100000:2.0:1789708858.114116:0:16575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789708858.114124:0:16575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1427032680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426328448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789708858.114162:0:16575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1427032680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1876645426328448:12345-0@lo:400:kworker.0 Request processed in 39us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708858.114168:0:16575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789708858.114190:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1427033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1876645426328448:0@lo:400:kworker.0 00000100:00080000:1.0:1789708858.115711:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789708858.117718:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789708858.117732:0:15034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a130a5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426329088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789708858.117775:0:15034:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789708858.117862:0:15034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a130a5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1876645426329088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (5765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708858.117871:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789708858.117902:0:3288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13082bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1876645426329088:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1789708858.142646:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:3.0:1789708858.142829:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:3.0:1789708858.143678:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:3.0:1789708858.143695:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:3.0:1789708858.143704:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:3.0:1789708858.143717:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1789708858.234859:0:15969:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789708858.747439:0:14375:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789708858.747449:0:14375:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708858.747529:0:14375:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789708858.747543:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789708858.747695:0:14375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434b97800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14375:1876645426329216:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789708858.747853:0:14375:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a142d9d39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789708858.753200:0:14375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434b97800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14375:1876645426329216:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789708858.755513:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708858.755810:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415867392 00000100:00100000:2.0:1789708858.755820:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415867392 00000100:00100000:2.0:1789708858.755905:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:2.0:1789708858.755925:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+11:14468:x1876645415867392:12345-192.168.202.53@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789708858.756018:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+11:14468:x1876645415867392:12345-192.168.202.53@tcp:900:lhsmtool_posix.0 Request processed in 104us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708858.756026:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00080000:1.0:1789708858.756540:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789708858.759642:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708858.759791:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415867520 00000100:00100000:2.0:1789708858.759802:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415867520 00000100:00100000:3.0:1789708858.759965:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:3.0:1789708858.759979:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13082bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+11:14468:x1876645415867520:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789708858.760013:0:14344:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789708858.760144:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13082bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+11:14468:x1876645415867520:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 169us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708858.760153:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:0.0:1789708858.773490:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708858.773769:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415867648 00000100:00100000:2.0:1789708858.773780:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415867648 00000100:00100000:2.0:1789708858.773848:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:2.0:1789708858.773860:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+11:14468:x1876645415867648:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789708858.773984:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68676de lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774009:0:15054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68676de lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774021:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68676de lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774040:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676e5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774047:0:15054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774065:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774091:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68676ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774100:0:15054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68676ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774106:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68676ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789708858.774148:0:15054:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789708858.774152:0:15054:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789708858.774165:0:15054:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68676ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774176:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68676de lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774193:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68676de lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774357:0:15054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68676de lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774363:0:15054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708858.774368:0:15054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68676de lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774376:0:15054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68676de lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774390:0:15054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1414c38400) 00010000:00010000:2.0:1789708858.774393:0:15054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708858.774398:0:15054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68676de lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774404:0:15054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c68676de lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774417:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774422:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676e5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774427:0:15054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676e5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774432:0:15054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6b200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708858.774441:0:15054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676e5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774447:0:15054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676e5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774465:0:15054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8a1414c38a00) 00010000:00010000:2.0:1789708858.774468:0:15054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708858.774470:0:15054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676e5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774476:0:15054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c68676e5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774490:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68676ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774496:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68676ec lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774502:0:15054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68676ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774507:0:15054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6aa00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708858.774510:0:15054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68676ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774516:0:15054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68676ec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774523:0:15054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:2.0:1789708858.774525:0:15054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708858.774538:0:15054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68676ec lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.774544:0:15054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c68676ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708858.774843:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+11:14468:x1876645415867648:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 Request processed in 982us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708858.774853:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:0.0:1789708858.781954:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708858.782749:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415867904 00000100:00100000:3.0:1789708858.782767:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415867904 00000100:00100000:3.0:1789708858.782861:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00100000:3.0:1789708858.782873:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+11:14468:x1876645415867904:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708858.782904:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708858.782944:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68676f3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4d25 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.783082:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68676fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.783112:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68676fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.783127:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68676fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789708858.783141:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789708858.783355:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68676fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.783364:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68676fa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.783371:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68676fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.783379:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708858.783383:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68676fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.783391:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68676fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.783406:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:3.0:1789708858.783409:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789708858.783415:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68676fa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.783421:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c68676fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.783493:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68676f3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d25 expref: 13 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.783504:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1414c38400) 00010000:00010000:3.0:1789708858.783506:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789708858.783509:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c68676f3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d25 expref: 13 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.783530:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc5000, rc 0) 00000100:00100000:3.0:1789708858.783612:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+12:14468:x1876645415867904:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 740us (1676us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1789708858.783621:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00100000:0.0:1789708858.789584:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708858.793574:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415868032 00000100:00100000:1.0:1789708858.793600:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415868032 00000100:00100000:1.0:1789708858.793726:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:1.0:1789708858.793742:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+12:14468:x1876645415868032:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789708858.793796:0:14346:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789708858.794366:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+12:14468:x1876645415868032:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 625us (4797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708858.794387:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:0.0:1789708858.803355:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708858.806818:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415868288 00000100:00100000:2.0:1789708858.806845:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415868288 00000100:00100000:2.0:1789708858.807898:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:2.0:1789708858.808043:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+12:14468:x1876645415868288:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708858.808074:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708858.808322:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867708 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4d2c expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789708858.815765:0:14345:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:2.0:1789708858.815791:0:14345:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1789708858.816317:0:14345:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1789708858.819632:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c686770f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.819820:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c686770f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.819992:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c686770f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.821219:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867708 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d2c expref: 15 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.821278:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c686770f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d2c expref: 14 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.821290:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1414c38a00) 00010000:00010000:2.0:1789708858.821294:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789708858.821298:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6b200, rc 0) 00000100:00100000:2.0:1789708858.821398:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+14:14468:x1876645415868288:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 13486us (18058us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1789708858.821410:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:0.0:1789708858.828167:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708858.828329:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415868544 00000100:00100000:2.0:1789708858.828343:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415868544 00000100:00100000:2.0:1789708858.828479:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:2.0:1789708858.828492:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+14:14468:x1876645415868544:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789708858.828583:0:15054:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708858.828621:0:15054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6b200/0xa8f741d1c686770f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d2c expref: 14 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.828646:0:15054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1414c38a00) 00010000:00010000:2.0:1789708858.828703:0:15054:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789708858.828733:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686771d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.828749:0:15054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686771d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.828760:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686771d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.828795:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867724 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x521f1ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.828802:0:15054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867724 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x521f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.828810:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867724 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x521f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.829083:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686771d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.829093:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686771d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.829100:0:15054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686771d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.829107:0:15054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a800 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708858.829112:0:15054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686771d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.829120:0:15054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686771d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.829130:0:15054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a14148f3800) 00010000:00010000:2.0:1789708858.829133:0:15054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708858.829138:0:15054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686771d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.829144:0:15054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a800/0xa8f741d1c686771d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.829163:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867724 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x521f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.829170:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867724 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x521f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.829176:0:15054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867724 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x521f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.829181:0:15054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6be00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708858.829199:0:15054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867724 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x521f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.829207:0:15054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867724 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x521f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.829215:0:15054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x521f1ce (ffff8a1414c38500) 00010000:00010000:2.0:1789708858.829218:0:15054:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708858.829221:0:15054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867724 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x521f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.829228:0:15054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867724 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x521f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708858.829332:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+13:14468:x1876645415868544:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 841us (1178us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789708858.829341:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:0.0:1789708858.836525:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708858.836788:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415868672 00000100:00100000:3.0:1789708858.836802:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415868672 00000100:00100000:3.0:1789708858.836870:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:3.0:1789708858.836884:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+13:14468:x1876645415868672:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789708858.836913:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789708858.837018:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c686772b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4d33 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.837069:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c6867732 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.837083:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c6867732 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.837093:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c6867732 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708858.840841:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5000/0xa8f741d1c686772b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d33 expref: 15 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708858.840877:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc4200/0xa8f741d1c6867732 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d33 expref: 14 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708858.840914:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1411b4a100) 00010000:00010000:0.0:1789708858.841069:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789708858.841074:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a143efc4200, rc 0) 00000100:00100000:0.0:1789708858.841181:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+14:14468:x1876645415868672:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 4297us (4669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708858.841203:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:0.0:1789708858.854325:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708858.861044:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415868928 00000100:00100000:1.0:1789708858.861072:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415868928 00000100:00100000:1.0:1789708858.861184:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:1.0:1789708858.861198:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+14:14468:x1876645415868928:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789708858.861330:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c6867739 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708858.861355:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c6867739 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708858.861369:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c6867739 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789708858.863498:0:14346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1789708858.865017:0:14346:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 424662363920ns, next at 425662353014ns, rc = 0 00000004:00010000:1.0:1789708858.865215:0:14346:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000923ab159 reply state 0000000050fc620e transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c6867739 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708858.865229:0:14346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789708858.865420:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+16:14468:x1876645415868928:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 4219us (11104us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789708858.865433:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 46 00010000:00010000:3.0:1789708858.871012:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c6867739 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.871039:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c6867739 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.871049:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c6867739 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.871080:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed8200 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708858.871086:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c6867739 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.871096:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c6867739 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.871121:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1411b4a100) 00010000:00010000:3.0:1789708858.871125:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789708858.871134:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c6867739 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708858.871140:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c6867739 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708858.871827:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708858.872420:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415869056 00000100:00100000:1.0:1789708858.872434:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415869056 00000100:00100000:1.0:1789708858.872528:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:1.0:1789708858.872541:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+15:14468:x1876645415869056:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708858.872573:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708858.872613:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867740 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4d3a expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708858.872746:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867740 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d3a expref: 16 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708858.872763:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867740 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d3a expref: 16 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708858.872787:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1411b4a100) 00010000:00010000:1.0:1789708858.872791:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789708858.872797:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1414ed8800, rc 0) 00000100:00100000:1.0:1789708858.872875:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+16:14468:x1876645415869056:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 336us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708858.872884:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:0.0:1789708858.878644:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708858.881770:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415869184 00000100:00100000:2.0:1789708858.881794:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415869184 00000100:00080000:1.0:1789708858.882050:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789708858.882159:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:2.0:1789708858.882201:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14344c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+5:2361:x1876645415869184:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789708858.883057:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14344c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:2361:x1876645415869184:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 857us (4421us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789708858.885380:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:0.0:1789708858.886764:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708858.886840:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415869440 00000100:00100000:1.0:1789708858.886852:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415869440 00000100:00100000:1.0:1789708858.886973:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:1.0:1789708858.886987:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+16:14468:x1876645415869440:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789708858.887293:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+17:14468:x1876645415869440:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 309us (538us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1789708858.887302:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:0.0:1789708858.892033:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708858.892543:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415869696 00000100:00100000:2.0:1789708858.892556:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415869696 00000100:00100000:2.0:1789708858.892696:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 48 00000100:00100000:2.0:1789708858.892710:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+17:14468:x1876645415869696:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789708858.892934:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+17:14468:x1876645415869696:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 226us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708858.892943:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 48 00000100:00100000:0.0:1789708858.897362:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708858.897483:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415869824 00000100:00100000:1.0:1789708858.897497:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415869824 00000100:00100000:1.0:1789708858.897570:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:1.0:1789708858.897582:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+17:14468:x1876645415869824:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789708858.897632:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789708858.897701:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8e00/0xa8f741d1c6867747 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4d41 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708858.897804:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686774e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708858.897822:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686774e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708858.897834:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686774e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789708858.897881:0:14345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789708858.897903:0:14345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686774e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708858.897934:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8e00/0xa8f741d1c6867747 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d41 expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708858.897954:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686774e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d41 expref: 18 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708858.897964:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1411b4a100) 00010000:00010000:1.0:1789708858.897968:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789708858.897972:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1414ed8200, rc 0) 00000100:00100000:1.0:1789708858.898362:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+18:14468:x1876645415869824:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 780us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708858.898372:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:0.0:1789708858.903570:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708858.903647:0:16575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415869952 00000100:00100000:2.0:1789708858.903707:0:16575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415869952 00000100:00100000:2.0:1789708858.903781:0:16575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:2.0:1789708858.903793:0:16575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:2362:x1876645415869952:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708858.903818:0:16575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708858.903845:0:16575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c6867755 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4d48 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789708858.903877:0:16575:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aacca3b, blocks: 0x1 00010000:00010000:2.0:1789708858.903904:0:16575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=424s v=(0 0) 00010000:00010000:2.0:1789708858.903908:0:16575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708858.903920:0:16575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c6867755 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d48 expref: 7 pid: 16575 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.903969:0:16575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c6867755 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d48 expref: 7 pid: 16575 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708858.903997:0:16575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6be00, rc 0) 00000100:00100000:2.0:1789708858.905258:0:16575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+7:2362:x1876645415869952:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 306us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708858.905280:0:16575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:0.0:1789708858.908823:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708858.909032:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415870208 00000100:00100000:2.0:1789708858.909047:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415870208 00000100:00100000:2.0:1789708858.909307:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:2.0:1789708858.909318:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+18:14468:x1876645415870208:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789708858.909448:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+18:14468:x1876645415870208:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 133us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708858.909466:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:3.0:1789708858.914789:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708858.914926:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415870336 00000100:00100000:0.0:1789708858.914940:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415870336 00000100:00100000:0.0:1789708858.915024:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:0.0:1789708858.915037:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+18:14468:x1876645415870336:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789708858.997859:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1789708858.997878:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1789708858.997942:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+14:14468:x1876645415870336:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 Request processed in 82893us (83155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708858.997959:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:3.0:1789708858.998607:0:3289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434b97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426329344:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789708858.998789:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708858.998981:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426329344 00000100:00100000:0.0:1789708858.998989:0:15032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426329344 00000100:00100000:0.0:1789708858.999046:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789708858.999056:0:15032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1876645426329344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789708858.999551:0:15032:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789708858.999556:0:15032:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789708858.999558:0:15032:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789708858.999560:0:15032:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789708859 -> 1789708859 00002000:00010000:0.0:1789708858.999563:0:15032:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789708858.999705:0:15032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3289:x1876645426329344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 650us (915us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789708858.999715:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1789708859.000047:0:3289:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a1434b97800/2, rc 0, transno 8589934595 00000100:00100000:3.0:1789708859.000791:0:3289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434b97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1876645426329344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789708859.002940:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708859.003029:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415870464 00000100:00100000:2.0:1789708859.003038:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415870464 00000100:00100000:2.0:1789708859.003090:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:2.0:1789708859.003099:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+7:2362:x1876645415870464:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789708859.003244:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+7:2362:x1876645415870464:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 Request processed in 136us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708859.003259:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:0.0:1789708859.012623:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708859.012760:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415870720 00000100:00100000:1.0:1789708859.012769:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415870720 00000100:00100000:1.0:1789708859.012812:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:1.0:1789708859.012819:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+14:14468:x1876645415870720:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789708859.012870:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708859.012897:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8200/0xa8f741d1c686774e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d41 expref: 14 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.012914:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1411b4a100) 00010000:00010000:1.0:1789708859.012918:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789708859.012952:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8e00/0xa8f741d1c686775c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.012962:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8e00/0xa8f741d1c686775c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.012969:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8e00/0xa8f741d1c686775c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789708859.013143:0:14346:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008608d524 reply state 000000000d9f2e54 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8e00/0xa8f741d1c686775c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708859.013150:0:14346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789708859.013292:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+15:14468:x1876645415870720:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 471us (675us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1789708859.013300:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 52 00010000:00010000:1.0:1789708859.018716:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8e00/0xa8f741d1c686775c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.018738:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8e00/0xa8f741d1c686775c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.018764:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8e00/0xa8f741d1c686775c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.018770:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed8e00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:1.0:1789708859.018775:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8e00/0xa8f741d1c686775c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.018784:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8e00/0xa8f741d1c686775c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.018801:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1411b4a100) 00010000:00010000:1.0:1789708859.018805:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789708859.018810:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8e00/0xa8f741d1c686775c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.018816:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8e00/0xa8f741d1c686775c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708859.019427:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708859.019571:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415870848 00000100:00100000:2.0:1789708859.019581:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415870848 00000100:00100000:2.0:1789708859.019711:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:2.0:1789708859.019731:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+7:14468:x1876645415870848:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789708859.019751:0:15031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789708859.019769:0:15031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f304147/0xa8f741d1c6867763 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb36fcef73e8d4d4f expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.019802:0:15031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c6867755 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d48 expref: 8 pid: 16575 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.019812:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708859.019817:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708859.019823:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f304147/0xa8f741d1c6867763 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d4f expref: 8 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.019858:0:15031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c6867755 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d48 expref: 8 pid: 16575 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.019873:0:15031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c6867755 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d48 expref: 8 pid: 16575 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708859.019888:0:15031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f513800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15031:1876645426329472:192.168.202.53@tcp:104: 00000100:00100000:2.0:1789708859.019984:0:15031:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1407e3a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708859.022727:0:15031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f513800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15031:1876645426329472:192.168.202.53@tcp:104: 00010000:00010000:2.0:1789708859.022761:0:15031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f304147/0xa8f741d1c6867763 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d4f expref: 8 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.022805:0:15031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1403b6a800, rc 0) 00000100:00100000:2.0:1789708859.022862:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+8:14468:x1876645415870848:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 3133us (3439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708859.022871:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:3.0:1789708859.024482:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708859.024959:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415870976 00000100:00100000:2.0:1789708859.024970:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415870976 00010000:00010000:2.0:1789708859.025013:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c6867755 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d48 expref: 8 pid: 16575 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708859.025060:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:2.0:1789708859.025070:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f272300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+8:2361:x1876645415870976:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789708859.025088:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789708859.025114:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c6867755 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d48 expref: 8 pid: 16575 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.025128:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c6867755 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d48 expref: 8 pid: 16575 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.025152:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c6867755 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d48 expref: 8 pid: 16575 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.025170:0:14330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708859.025174:0:14330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708859.025182:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f304147/0xa8f741d1c6867763 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d4f expref: 7 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.025212:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f304147/0xa8f741d1c6867763 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d4f expref: 7 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.025258:0:14330:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002f304147/0xa8f741d1c6867763 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d4f expref: 7 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708859.025273:0:14330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f513800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14330:1876645426329600:192.168.202.53@tcp:105: 00000100:00100000:2.0:1789708859.025374:0:14330:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1407e3a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708859.029134:0:14330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f513800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14330:1876645426329600:192.168.202.53@tcp:105: 00010000:00010000:2.0:1789708859.029163:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789708859.029233:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f272300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+7:2361:x1876645415870976:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 4164us (4758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708859.029254:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:1.0:1789708859.030512:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708859.030843:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415871104 00000100:00100000:2.0:1789708859.030852:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415871104 00000100:00100000:2.0:1789708859.030914:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:2.0:1789708859.030926:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+7:2362:x1876645415871104:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789708859.031133:0:15029:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789708859.031137:0:15029:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789708858 00002000:00010000:2.0:1789708859.031139:0:15029:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789708857 00002000:00010000:2.0:1789708859.031141:0:15029:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789708859 -> 1789708858 00002000:00010000:2.0:1789708859.031144:0:15029:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789708859.031207:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+8:2362:x1876645415871104:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 283us (701us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789708859.031225:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:3.0:1789708859.035477:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708859.036089:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415871232 00000100:00100000:0.0:1789708859.036100:0:15032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415871232 00000100:00100000:0.0:1789708859.036212:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:0.0:1789708859.036224:0:15032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+8:2363:x1876645415871232:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789708859.036433:0:15032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd38e81d/0xa8f741d1c686776a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708859.036501:0:15032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f304147/0xa8f741d1c6867763 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d4f expref: 8 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708859.036512:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708859.036517:0:15032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789708859.036522:0:15032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd38e81d/0xa8f741d1c686776a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708859.036559:0:15032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f304147/0xa8f741d1c6867763 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d4f expref: 8 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708859.036588:0:15032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f304147/0xa8f741d1c6867763 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d4f expref: 8 pid: 15031 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708859.036602:0:15032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143fb2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15032:1876645426329728:192.168.202.53@tcp:104: 00000100:00100000:0.0:1789708859.036805:0:15032:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1302c290c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789708859.040369:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708859.040526:0:15032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143fb2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15032:1876645426329728:192.168.202.53@tcp:104: 00010000:00010000:0.0:1789708859.040557:0:15032:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bd38e81d/0xa8f741d1c686776a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708859.040716:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415871360 00000100:00100000:1.0:1789708859.040724:0:14331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415871360 00010000:00010000:1.0:1789708859.040763:0:14331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f304147/0xa8f741d1c6867763 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d4f expref: 9 pid: 15031 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708859.040804:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:1.0:1789708859.040814:0:14331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+9:2361:x1876645415871360:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789708859.040829:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789708859.040849:0:14331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f304147/0xa8f741d1c6867763 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d4f expref: 9 pid: 15031 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.040874:0:14331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f304147/0xa8f741d1c6867763 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d4f expref: 9 pid: 15031 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.040898:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f304147/0xa8f741d1c6867763 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d4f expref: 9 pid: 15031 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.040926:0:14331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708859.040931:0:14331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789708859.040937:0:14331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd38e81d/0xa8f741d1c686776a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.040946:0:14331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd38e81d/0xa8f741d1c686776a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.040976:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789708859.041037:0:14331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f272d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+8:2361:x1876645415871360:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 224us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708859.041045:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00010000:00010000:3.0:1789708859.041361:0:15032:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bd38e81d/0xa8f741d1c686776a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.041382:0:15032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd38e81d/0xa8f741d1c686776a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.041406:0:15032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd38e81d/0xa8f741d1c686776a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.041415:0:15032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd38e81d/0xa8f741d1c686776a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.041424:0:15032:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd38e81d/0xa8f741d1c686776a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.041430:0:15032:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a8200 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708859.041434:0:15032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd38e81d/0xa8f741d1c686776a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.041442:0:15032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd38e81d/0xa8f741d1c686776a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.041465:0:15032:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd38e81d/0xa8f741d1c686776a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.041473:0:15032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd38e81d/0xa8f741d1c686776a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708859.041534:0:15032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+7:2363:x1876645415871232:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 Request processed in 5313us (6067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708859.041542:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:1.0:1789708859.044562:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708859.044892:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415871616 00000100:00100000:2.0:1789708859.044901:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415871616 00000100:00100000:2.0:1789708859.045075:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:2.0:1789708859.045095:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+14:14468:x1876645415871616:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789708859.045181:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867771 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.045199:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867771 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.045211:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867771 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.045621:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867778 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.045636:0:14345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867740 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d3a expref: 15 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.045645:0:14345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867778 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.046140:0:14345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867740 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d3a expref: 15 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.046155:0:14345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867740 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d3a expref: 15 pid: 14345 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708859.046184:0:14345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f513800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14345:1876645426329856:192.168.202.53@tcp:104: 00000100:00100000:2.0:1789708859.046733:0:14345:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1407e3a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708859.052555:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708859.052680:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415871744 00000100:00100000:0.0:1789708859.052699:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415871744 00010000:00010000:0.0:1789708859.052745:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867740 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d3a expref: 16 pid: 14345 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708859.052786:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:0.0:1789708859.052796:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f512680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+16:2362:x1876645415871744:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789708859.052813:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789708859.052820:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867740 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d3a expref: 16 pid: 14345 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708859.052833:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867740 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d3a expref: 16 pid: 14345 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708859.052858:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1411b4a100) 00010000:00010000:0.0:1789708859.052877:0:14330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867778 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708859.052887:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867778 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708859.052895:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867778 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708859.052930:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789708859.052999:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f512680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+16:2362:x1876645415871744:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 203us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708859.053008:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 15 00010000:00010000:1.0:1789708859.059720:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1414ed8800/0xa8f741d1c6867740 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d3a expref: 15 pid: 14345 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708859.059752:0:14345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f513800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14345:1876645426329856:192.168.202.53@tcp:104: 00010000:00010000:1.0:1789708859.059776:0:14345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867778 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.059814:0:14345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867778 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.059820:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867778 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789708859.060202:0:14345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1789708859.060512:0:14345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1789708859.060561:0:14345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1789708859.060788:0:14345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434b94a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14345:1876645426329984:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789708859.060868:0:14345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789708859.060954:0:14345:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a14055be0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789708859.062051:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426329984 00000100:00100000:2.0:1789708859.062323:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426329984 00000100:00100000:2.0:1789708859.062507:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789708859.062517:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1434b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14345:x1876645426329984:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789708859.062639:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14345:x1876645426329984:12345-0@lo:1000:mdt00_001.0 Request processed in 123us (1771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789708859.062671:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789708859.062769:0:14345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434b94a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14345:1876645426329984:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789708859.064207:0:14345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1789708859.064512:0:14345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f273100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14345:1876645426330112:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789708859.064588:0:14345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789708859.066112:0:14345:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405882180 going to sleep for 11 seconds 00000100:00100000:2.0:1789708859.066205:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426330112 00000100:00100000:2.0:1789708859.066216:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426330112 00000100:00100000:2.0:1789708859.066277:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789708859.066287:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14345:x1876645426330112:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789708859.066832:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14345:x1876645426330112:12345-0@lo:1000:mdt00_001.0 Request processed in 544us (2241us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789708859.066841:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789708859.066944:0:14345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f273100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14345:1876645426330112:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789708859.066990:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867778 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.067001:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867778 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.067009:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867778 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.067015:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6be00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708859.067020:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867778 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.067027:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867778 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.067043:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1411b4a100) 00010000:00010000:3.0:1789708859.067046:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789708859.067059:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867778 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.067934:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c6867778 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.067974:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68676d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.067982:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68676d0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.067989:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68676d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.067994:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6a600 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:3.0:1789708859.067997:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68676d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.068003:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68676d0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.068013:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:3.0:1789708859.068016:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789708859.068024:0:14345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c68676d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d1e expref: 18 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.068036:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c68676d7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d1e expref: 18 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.068046:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c68676d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d1e expref: 18 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.068122:0:14345:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5600/0xa8f741d1c68676d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xb36fcef73e8d4d1e expref: 18 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708859.068137:0:14345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a143f273800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14345:1876645426330240:192.168.202.53@tcp:105: 00000100:00100000:3.0:1789708859.068225:0:14345:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1405882480 going to sleep for 11 seconds 00000100:00100000:2.0:1789708859.072966:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708859.073106:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415871872 00000100:00100000:1.0:1789708859.073116:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415871872 00000100:00100000:1.0:1789708859.073174:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:1.0:1789708859.073185:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a14051edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+19:14465:x1876645415871872:12345-192.168.202.53@tcp:49:dd.0 00000100:00100000:1.0:1789708859.073332:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a14051edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+19:14465:x1876645415871872:12345-192.168.202.53@tcp:49:dd.0 Request processed in 148us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789708859.073503:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:3.0:1789708859.078891:0:14345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a143f273800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14345:1876645426330240:192.168.202.53@tcp:105: 00010000:00010000:3.0:1789708859.078989:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68676d0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.079002:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6a600/0xa8f741d1c68676d0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15054 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.089518:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686777f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.089541:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686777f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.089553:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686777f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.089581:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686777f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.089587:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686777f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.089594:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686777f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.089599:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6be00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708859.089602:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686777f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.089609:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686777f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.089620:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:2.0:1789708859.089622:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789708859.089627:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686777f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.089632:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6be00/0xa8f741d1c686777f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.089646:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867771 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.089667:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867771 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.089673:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867771 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.089695:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6aa00 already unused, calling callback (ffffffffc20741b0) 00010000:00010000:2.0:1789708859.089699:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867771 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.089705:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867771 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.089713:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1411b4a200) 00010000:00010000:2.0:1789708859.089715:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789708859.089718:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867771 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.089724:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1403b6aa00/0xa8f741d1c6867771 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708859.089984:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1434b95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+18:14468:x1876645415871616:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 44897us (45426us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789708859.089994:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 53 00000020:00080000:2.0:1789708859.090001:0:14345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789708859.092420:0:14375:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789708859.092428:0:14375:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789708859.092481:0:14375:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789708859.092494:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789708859.118841:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708859.124026:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415872128 00000100:00100000:2.0:1789708859.124044:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415872128 00000100:00100000:3.0:1789708859.128188:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:3.0:1789708859.128204:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+18:14468:x1876645415872128:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789708859.130851:0:14347:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789708859.130955:0:14347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1789708859.131007:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6867786 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.131025:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6867786 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.131038:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6867786 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.131047:0:14347:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6867786 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.131064:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6867786 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.131070:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6867786 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.131100:0:14347:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789708859.132799:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789708859.132813:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6867786 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708859.132823:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc5400 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:0.0:1789708859.132826:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6867786 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708859.132835:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6867786 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708859.132850:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1411b4a100) 00010000:00010000:0.0:1789708859.132854:0:14332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789708859.132859:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6867786 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708859.132864:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a143efc5400/0xa8f741d1c6867786 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708859.132898:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708859.132900:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789708859.132901:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708859.133069:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+20:14468:x1876645415872128:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 4863us (14976us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1789708859.133081:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00000020:00080000:3.0:1789708859.133502:0:14347:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789708859.261777:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789708859.322331:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708859.322390:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708859.322625:0:15036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415872256 00000100:00100000:1.0:1789708859.322636:0:15036:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415872256 00000100:00100000:1.0:1789708859.322731:0:15036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415872384 00000100:00100000:1.0:1789708859.322735:0:15036:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415872384 00000100:00100000:1.0:1789708859.322757:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:1.0:1789708859.322782:0:15036:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+8:2364:x1876645415872256:12345-192.168.202.53@tcp:4:dd.0 00002000:00010000:1.0:1789708859.322834:0:15036:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aacca3a, atime: 0x6aacca39, ctime: 0x6aacca3a, blocks: 0x1 00010000:00010000:1.0:1789708859.322843:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b4b61c5/0xa8f741d1c686778d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.322860:0:15036:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1789708859.322865:0:15036:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708859.322872:0:15036:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b4b61c5/0xa8f741d1c686778d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.322889:0:15036:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b4b61c5/0xa8f741d1c686778d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708859.325121:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1789708859.325878:0:15037:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789708859.325891:0:15037:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1789708859.326505:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415872512 00000100:00100000:1.0:1789708859.326516:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415872512 00000100:00100000:3.0:1789708859.328725:0:16580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:3.0:1789708859.328747:0:16580:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143fb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+10:2364:x1876645415872384:12345-192.168.202.53@tcp:4:dd.0 00010000:00010000:3.0:1789708859.328795:0:16580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c6867794 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.328815:0:16580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708859.328821:0:16580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708859.328828:0:16580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c6867794 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.328843:0:16580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c6867794 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789708859.436570:0:15036:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1789708859.436580:0:15036:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789708858 -> 1789708859 00002000:00010000:1.0:1789708859.436582:0:15036:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1789708859.436598:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b4b61c5/0xa8f741d1c686778d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.436612:0:15036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b4b61c5/0xa8f741d1c686778d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.436621:0:15036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b4b61c5/0xa8f741d1c686778d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.436674:0:15036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed8800 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708859.436767:0:15036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b4b61c5/0xa8f741d1c686778d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.436787:0:15036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b4b61c5/0xa8f741d1c686778d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.436808:0:15036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b4b61c5/0xa8f741d1c686778d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.436816:0:15036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b4b61c5/0xa8f741d1c686778d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708859.439495:0:15036:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+14:2364:x1876645415872256:12345-192.168.202.53@tcp:4:dd.0 Request processed in 114130us (114588us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789708859.439510:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:1.0:1789708859.439551:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:1.0:1789708859.439566:0:15036:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+13:2364:x1876645415872512:12345-192.168.202.53@tcp:4:dd.0 00010000:00010000:1.0:1789708859.439608:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fdce325/0xa8f741d1c686779b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.439625:0:15036:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708859.439630:0:15036:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708859.439637:0:15036:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fdce325/0xa8f741d1c686779b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.439753:0:15036:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fdce325/0xa8f741d1c686779b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789708859.440105:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:1.0:1789708859.440120:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:1.0:1789708859.440130:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:2.0:1789708859.489896:0:16580:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1789708859.489978:0:16580:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:2.0:1789708859.489998:0:16580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c6867794 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.490011:0:16580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c6867794 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.490037:0:16580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c6867794 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.490044:0:16580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4400 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:2.0:1789708859.490049:0:16580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c6867794 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.490059:0:16580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c6867794 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.490080:0:16580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c6867794 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.490087:0:16580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000492815dc/0xa8f741d1c6867794 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708859.490188:0:16580:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143fb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+11:2364:x1876645415872384:12345-192.168.202.53@tcp:4:dd.0 Request processed in 161443us (167790us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789708859.490202:0:16580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 1 00000001:00080000:2.0:1789708859.492771:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:2.0:1789708859.521193:0:15036:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1789708859.521216:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fdce325/0xa8f741d1c686779b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.521302:0:15036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fdce325/0xa8f741d1c686779b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.521323:0:15036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fdce325/0xa8f741d1c686779b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.521328:0:15036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed9200 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:2.0:1789708859.521332:0:15036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fdce325/0xa8f741d1c686779b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.521338:0:15036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fdce325/0xa8f741d1c686779b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.521353:0:15036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fdce325/0xa8f741d1c686779b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.521357:0:15036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fdce325/0xa8f741d1c686779b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708859.521457:0:15036:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+7:2364:x1876645415872512:12345-192.168.202.53@tcp:4:dd.0 Request processed in 81885us (196335us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789708859.521467:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 2 00000001:00080000:2.0:1789708859.521508:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000100:00100000:3.0:1789708859.528146:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708859.528195:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1789708859.528356:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415872640 00000100:00100000:2.0:1789708859.528367:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415872640 00000100:00100000:2.0:1789708859.528464:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415872768 00000100:00100000:2.0:1789708859.528468:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415872768 00000100:00100000:2.0:1789708859.528497:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:2.0:1789708859.528508:0:15035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+6:2363:x1876645415872640:12345-192.168.202.53@tcp:4:dd.0 00002000:00010000:2.0:1789708859.528575:0:15035:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aacca3b, atime: 0x6aacca39, ctime: 0x0, blocks: 0x1807 00010000:00010000:2.0:1789708859.528586:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c68677a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.528603:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1789708859.528608:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708859.528614:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c68677a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.528627:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c68677a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708859.528894:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:2.0:1789708859.528903:0:15036:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f271180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+7:2363:x1876645415872768:12345-192.168.202.53@tcp:4:dd.0 00010000:00010000:2.0:1789708859.528928:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c68677a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.528937:0:15036:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708859.528940:0:15036:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789708859.528944:0:15036:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c68677a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.528953:0:15036:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c68677a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708859.532352:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708859.533526:0:16580:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789708859.533540:0:16580:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1789708859.534217:0:16580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415872896 00000100:00100000:0.0:1789708859.534227:0:16580:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415872896 00000100:00100000:1.0:1789708859.536904:0:16582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:3.0:1789708859.541858:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708859.545894:0:16582:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f270a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+9:2363:x1876645415872896:12345-192.168.202.53@tcp:4:dd.0 00010000:00010000:0.0:1789708859.545955:0:16582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e00b8862/0xa8f741d1c68677b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708859.545972:0:16582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708859.545976:0:16582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789708859.545982:0:16582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e00b8862/0xa8f741d1c68677b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789708859.545998:0:16582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e00b8862/0xa8f741d1c68677b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789708859.546608:0:16580:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1789708859.551117:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1789708859.551214:0:16580:0:(service.c:3533:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1789708859.552049:0:16580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415873024 00000100:00100000:0.0:1789708859.552059:0:16580:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415873024 00000100:00100000:2.0:1789708859.553788:0:15037:0:(service.c:3474:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1789708859.553821:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415873152 00000100:00100000:2.0:1789708859.553830:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415873152 00000100:00100000:1.0:1789708859.561600:0:16583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:1.0:1789708859.561625:0:16583:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+12:2364:x1876645415873024:12345-192.168.202.53@tcp:4:dd.0 00010000:00010000:1.0:1789708859.561697:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7125c9f/0xa8f741d1c68677b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.561720:0:16583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708859.561726:0:16583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789708859.561733:0:16583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7125c9f/0xa8f741d1c68677b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.561747:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7125c9f/0xa8f741d1c68677b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789708859.632207:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:3.0:1789708859.632367:0:15035:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7340032 00002000:00010000:3.0:1789708859.632372:0:15035:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1789708859 00002000:00010000:3.0:1789708859.632375:0:15035:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1789708859.632392:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c68677a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.632406:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c68677a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.632417:0:15035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c68677a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.632425:0:15035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6aa00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708859.632431:0:15035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c68677a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.632440:0:15035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c68677a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.632493:0:15035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c68677a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.632501:0:15035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002db663e2/0xa8f741d1c68677a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708859.632591:0:15035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+18:2363:x1876645415872640:12345-192.168.202.53@tcp:4:dd.0 Request processed in 104079us (104464us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789708859.632614:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:3.0:1789708859.632647:0:15035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:3.0:1789708859.633559:0:15035:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143f271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+17:2364:x1876645415873152:12345-192.168.202.53@tcp:4:dd.0 00010000:00010000:3.0:1789708859.633595:0:15035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68677be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.633610:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708859.633615:0:15035:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789708859.633620:0:15035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68677be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.633632:0:15035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68677be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789708859.710685:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:3.0:1789708859.710795:0:16583:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1789708859.710800:0:16583:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:3.0:1789708859.710815:0:16583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7125c9f/0xa8f741d1c68677b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.710829:0:16583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7125c9f/0xa8f741d1c68677b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.710838:0:16583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7125c9f/0xa8f741d1c68677b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.710869:0:16583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1414ed9e00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:3.0:1789708859.710874:0:16583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7125c9f/0xa8f741d1c68677b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.710884:0:16583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7125c9f/0xa8f741d1c68677b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.710915:0:16583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7125c9f/0xa8f741d1c68677b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789708859.710923:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7125c9f/0xa8f741d1c68677b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789708859.711025:0:16583:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+13:2364:x1876645415873024:12345-192.168.202.53@tcp:4:dd.0 Request processed in 149404us (169168us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789708859.711037:0:16583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00010000:00010000:1.0:1789708859.712021:0:16582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e00b8862/0xa8f741d1c68677b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.712035:0:16582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e00b8862/0xa8f741d1c68677b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.712057:0:16582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e00b8862/0xa8f741d1c68677b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.712064:0:16582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a14014a9200 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708859.712068:0:16582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e00b8862/0xa8f741d1c68677b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.712076:0:16582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e00b8862/0xa8f741d1c68677b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.712093:0:16582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e00b8862/0xa8f741d1c68677b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.712100:0:16582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e00b8862/0xa8f741d1c68677b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708859.712165:0:16582:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f270a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+11:2363:x1876645415872896:12345-192.168.202.53@tcp:4:dd.0 Request processed in 171739us (179820us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789708859.712174:0:16582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00002000:00010000:2.0:1789708859.715295:0:15036:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1789708859.715318:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c68677a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.715330:0:15036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c68677a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.715338:0:15036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c68677a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.715345:0:15036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1403b6be00 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:2.0:1789708859.715349:0:15036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c68677a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.715358:0:15036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c68677a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.715379:0:15036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c68677a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789708859.715386:0:15036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b650196/0xa8f741d1c68677a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789708859.715489:0:15036:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f271180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+9:2363:x1876645415872768:12345-192.168.202.53@tcp:4:dd.0 Request processed in 186581us (187288us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1789708859.715515:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00000001:00080000:2.0:1789708859.746962:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:1.0:1789708859.747426:0:15035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68677be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.747452:0:15035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68677be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.747479:0:15035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68677be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.747486:0:15035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a143efc4000 already unused, calling callback (ffffffffc15726c0) 00010000:00010000:1.0:1789708859.747491:0:15035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68677be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.747500:0:15035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68677be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.747520:0:15035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68677be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789708859.747756:0:15035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000899dddfb/0xa8f741d1c68677be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789708859.747918:0:15035:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143f271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+5:2364:x1876645415873152:12345-192.168.202.53@tcp:4:dd.0 Request processed in 114362us (196797us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789708859.747929:0:15035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00010000:00010000:0.0:1789708860.284870:0:15969:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789708860.666994:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1434b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426330368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708860.667077:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789708860.667612:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645426330368 00000100:00100000:0.0:1789708860.667634:0:15034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645426330368 00000100:00100000:0.0:1789708860.667740:0:15034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789708860.667752:0:15034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426330368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789708860.667775:0:15034:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3859808256 avail 3849322496 00000100:00100000:0.0:1789708860.667835:0:15034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876645426330368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789708860.667844:0:15034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789708860.667920:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789708860.668037:0:3286:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1789708860.668043:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a1434b97800, transno 8589934595 00000004:00080000:3.0:1789708860.668061:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1789708860.668101:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1434b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1876645426330368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789708861.178951:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708861.178992:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708861.179036:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708861.179065:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708861.179085:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708861.179104:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708861.179131:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1789708861.179167:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415873408 00000100:00100000:3.0:1789708861.179178:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415873408 00000100:00100000:3.0:1789708861.179249:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415873792 00000100:00100000:3.0:1789708861.179253:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415873792 00000100:00100000:3.0:1789708861.179279:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:3.0:1789708861.179290:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+20:2361:x1876645415873408:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708861.179368:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+20:2361:x1876645415873408:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 79us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708861.179375:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:3.0:1789708861.179392:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:3.0:1789708861.179398:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:2361:x1876645415873792:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708861.179427:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a2dd95b-f0e7-4239-8480-4d058ec34c66+6:2361:x1876645415873792:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 28us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708861.179444:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:3.0:1789708861.179465:0:16575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415873664 00000100:00100000:3.0:1789708861.179468:0:16575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415873664 00000100:00100000:3.0:1789708861.179488:0:16575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415873920 00000100:00100000:3.0:1789708861.179490:0:16575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415873920 00000100:00100000:3.0:1789708861.179504:0:16575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415873536 00000100:00100000:3.0:1789708861.179506:0:16575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415873536 00000100:00100000:3.0:1789708861.179533:0:16575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415874048 00000100:00100000:3.0:1789708861.179536:0:16575:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415874048 00000100:00100000:3.0:1789708861.179550:0:16575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:3.0:1789708861.179564:0:16575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+5:2361:x1876645415873664:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708861.179592:0:16575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+5:2361:x1876645415873664:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 30us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708861.179598:0:16575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:3.0:1789708861.179611:0:16575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:3.0:1789708861.179617:0:16575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a2dd95b-f0e7-4239-8480-4d058ec34c66+5:2361:x1876645415873920:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708861.179640:0:16575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a2dd95b-f0e7-4239-8480-4d058ec34c66+5:2361:x1876645415873920:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708861.179647:0:16575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:3.0:1789708861.179686:0:16575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:3.0:1789708861.179692:0:16575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+5:2361:x1876645415873536:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708861.179716:0:16575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74399bf8-2bc4-4c5c-bc42-6f3178bb0ac7+5:2361:x1876645415873536:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708861.179722:0:16575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:3.0:1789708861.179733:0:16575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:3.0:1789708861.179738:0:16575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1435cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a2dd95b-f0e7-4239-8480-4d058ec34c66+5:2361:x1876645415874048:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708861.179762:0:16575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1435cc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a2dd95b-f0e7-4239-8480-4d058ec34c66+5:2361:x1876645415874048:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 23us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708861.179767:0:16575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:3.0:1789708861.179788:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876645415873280 00000100:00100000:3.0:1789708861.179794:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876645415873280 00000100:00100000:3.0:1789708861.179819:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 123 00000100:00100000:3.0:1789708861.179826:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a143e1ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:2361:x1876645415873280:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1789708861.179859:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a143e1ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7744a29-3faa-4bfb-93f0-0fca1ce60cc2+13:2361:x1876645415873280:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 33us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789708861.179866:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 123 00000100:00080000:3.0:1789708861.179902:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789708861.179906:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789708861.179909:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789708861.315367:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789708861.420491:0:16620:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1789708862.331870:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28255 lines, 28255 kept, 0 dropped, 0 bad.